Jul 08 18:35:19 devstack cinder-volume[75996]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:35:19 devstack cinder-volume[75996]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:35:19 devstack cinder-volume[75996]: we strongly recommend against using it for new projects. Jul 08 18:35:19 devstack cinder-volume[75996]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:35:19 devstack cinder-volume[75996]: framework. For more detail see Jul 08 18:35:19 devstack cinder-volume[75996]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:35:19 devstack cinder-volume[75996]: import eventlet # noqa Jul 08 18:35:22 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:35:22 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:35:22 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:35:22 devstack cinder-volume[75996]: INFO dbcounter [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Registered counter for database cinder Jul 08 18:35:22 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writer thread running {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:35:23 devstack cinder-volume[75996]: INFO cinder.rpc [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:35:23 devstack cinder-volume[75996]: INFO cinder.rpc [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:35:23 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Determined volume DB was empty at startup. Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75996) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:35:23 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:35:23 devstack cinder-volume[75996]: WARNING stevedore.named [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:35:23 devstack cinder-volume[75996]: WARNING castellan.key_manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:35:23 devstack cinder-volume[75996]: WARNING cinder.keymgr.conf_key_mgr [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75996) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] CMD "cinder-rtstool verify" returned: 0 in 0.422s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:35:24 devstack cinder-volume[75996]: INFO cinder.rpc [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 18:35:24 devstack cinder-volume[75996]: INFO cinder.rpc [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 18:35:24 devstack cinder-volume[75996]: WARNING stevedore.named [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:35:24 devstack cinder-volume[75996]: WARNING castellan.key_manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:35:24 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:35:24 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Starting 1 workers Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Started child 76157 {{(pid=75996) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:35:24 devstack cinder-volume[76157]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Full set of CONF: {{(pid=75996) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] ******************************************************************************** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Configuration options gathered from: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] ================================================================================ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] allow_availability_zone_fallback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] allow_compression_on_image_upload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] allowed_direct_url_schemes = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] api_rate_limit = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] auth_strategy = keystone {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] az_cache_duration = 3600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_host = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_stats_polling_interval = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backup_api_class = cinder.backup.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backup_name_template = backup-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backup_use_same_host = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backup_use_temp_snapshot = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] chap_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_internal_tenant_project_id = 8b03f18378d24131bbb52179c84e6977 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_internal_tenant_user_id = 29c69d5afc9f4b25bc59735fabd3ae38 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cloned_volume_same_az = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cluster = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] compression_format = gzip {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] compute_api_class = cinder.compute.nova.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] config_dir = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] config_source = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] control_exchange = openstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] debug = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] default_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] default_group_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] default_volume_type = lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_ssl_cert_verify = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] driver_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] enable_force_upload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] enable_new_services = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] enable_unsupported_driver = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] enabled_backends = ['lvmdriver-1'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] enforce_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_api_insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_api_servers = ['http://192.168.122.204/image'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_api_ssl_compression = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_ca_certificates_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_catalog_info = image:glance:publicURL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_num_retries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance_request_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] graceful_shutdown_timeout = 5 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] group_api_class = cinder.group.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] host = devstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_compress_on_upload = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_conversion_address_space_limit = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_conversion_cpu_limit = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_conversion_disable = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_upload_use_cinder_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_upload_use_internal_tenant = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_volume_cache_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_volume_cache_max_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] image_volume_cache_max_size_gb = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] init_host_max_objects_retrieval = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] instance_format = [instance: %(uuid)s] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iscsi_target_flags = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iscsi_write_cache = on {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iser_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iser_ip_address = 192.168.122.204 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iser_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_color = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_config_append = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_options = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_rotate_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_rotate_interval_type = days {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] log_rotation_type = none {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] max_age = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] max_logfile_count = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] max_logfile_size_mb = 200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] max_over_subscription_ratio = 20.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] message_reap_interval = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] message_ttl = 2592000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] migration_create_volume_timeout_secs = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] monkey_patch = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] monkey_patch_modules = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] my_ip = 192.168.122.204 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] no_snapshot_gb_quota = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] num_iser_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] num_shell_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] num_volume_device_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] nvmeof_conn_info_version = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] nvmet_ns_id = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] nvmet_port_id = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_max_limit = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_ext_list = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_listen = 0.0.0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_listen_port = 8776 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] osapi_volume_workers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] per_volume_size_limit = -1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] periodic_fuzzy_delay = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] periodic_interval = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] project_id_regex = [0-9a-f\-]+ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] public_endpoint = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] publish_errors = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_backup_gigabytes = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_backups = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_gigabytes = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_groups = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_snapshots = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] quota_volumes = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] rate_limit_burst = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] rate_limit_except_level = CRITICAL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] rate_limit_interval = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] reinit_driver_count = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] report_discard_supported = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] report_interval = 120 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] reservation_clean_interval = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] reservation_expire = 86400 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] reserved_image_namespaces = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] reserved_percentage = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] rpc_response_timeout = 120 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] run_external_periodic_tasks = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] scst_target_driver = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_down_time = 720 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] shell_completion = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] snapshot_name_template = snapshot-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] snapshot_same_host = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] state_path = /opt/stack/data/cinder {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] storage_availability_zone = nova {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] storage_protocol = iSCSI {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] syslog_log_facility = LOG_USER {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_helper = lioadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_ip_address = 192.168.122.204 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] target_secondary_ip_addresses = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] transfer_api_class = cinder.transfer.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] transport_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] until_refresh = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_chap_auth = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_default_quota_class = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_journal = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_json = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_stderr = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] use_syslog = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] verify_glance_signatures = enabled {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_api_class = cinder.volume.api.API {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_clear_size = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_copy_bps_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_dd_blocksize = 1M {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_name_template = volume-%s {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_service_inithost_offload = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volume_usage_audit_period = month {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] zoning_mode = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_concurrency.disable_process_locking = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.auth_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.cache = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.include_service_catalog = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.interface = public {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_password = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcache_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.service_token_roles_required = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.service_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.backend = dogpile.cache.null {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.backend_argument = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.backend_expiration_time = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.config_prefix = cache.oslo {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.debug_cache_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.enable_retry_client = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.enable_socket_keepalive = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.expiration_time = 600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.hashclient_retry_attempts = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_dead_retry = 300 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_pool_maxsize = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_sasl_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.proxies = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.redis_db = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.redis_server = localhost:6379 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.retry_attempts = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.retry_delay = 0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.socket_keepalive_count = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.socket_keepalive_idle = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.socket_keepalive_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.socket_timeout = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.tls_allowed_ciphers = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.tls_cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.tls_certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.tls_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.tls_keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cache.username = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] coordination.backend_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.asyncio_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.asyncio_slave_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.backend = sqlalchemy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.connection_debug = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.connection_parameters = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.connection_recycle_time = 3600 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.connection_trace = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.db_inc_retry_interval = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.db_max_retries = 20 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.db_max_retry_interval = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.db_retry_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.max_overflow = 50 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.max_pool_size = 5 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.max_retries = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.mysql_wsrep_sync_wait = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.pool_timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.retry_interval = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.slave_connection = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.sqlite_synchronous = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.synchronous_reader = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] database.use_db_reconnect = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.connection_string = messaging:// {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.es_doc_type = notification {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.es_scroll_size = 10000 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.es_scroll_time = 2m {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.filter_error_trace = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.hmac_keys = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.sentinel_service_name = mymaster {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.socket_timeout = 0.1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.trace_requests = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler.trace_sqlalchemy = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler_jaeger.process_tags = {} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler_jaeger.service_name_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] profiler_otlp.service_name_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.enforce_new_defaults = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.enforce_scope = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.policy_default_rule = default {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.policy_file = policy.yaml {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack sudo[76161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_policy.remote_timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.group = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.helper_command = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack sudo[76161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] privsep_osbrick.user = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.group = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.helper_command = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] cinder_sys_admin.user = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.send_service_user_token = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] service_user.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.auth_type = password {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] glance.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.chap_username = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.driver_use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.extra_capabilities = {} {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iscsi_target_flags = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iscsi_write_cache = on {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iser_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iser_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.lvm_mirrors = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.lvm_share_target = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.lvm_type = auto {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.num_shell_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.report_discard_supported = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.reserved_percentage = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_helper = tgtadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.unique_fqdn_network = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.use_chap_auth = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_backend_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_clear_size = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volume_group = cinder-volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_reports.file_event_handler = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_reports.log_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.backend_availability_zone = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.backend_host = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.chap_password = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.chap_username = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.chiscsi_conf = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.disk_geometry = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_client_cert = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_data_namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.driver_use_ssl = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.extra_capabilities = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.filter_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.goodness_function = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iser_helper = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iser_ip_address = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iser_port = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.iser_target_prefix = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.lvm_conf_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.lvm_mirrors = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.lvm_share_target = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.lvm_type = auto {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.num_shell_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.nvmet_port_id = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.replication_device = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.report_discard_supported = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.reserved_percentage = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.scst_target_driver = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.storage_protocol = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_helper = lioadm {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_ip_address = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_port = 3260 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_protocol = iscsi {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.trace_flags = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.use_chap_auth = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_clear = zero {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_clear_size = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] lvmdriver-1.volumes_dir = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.ssl_version = {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_notifications.driver = [] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_notifications.retry = -1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] key_manager.fixed_key = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.barbican_api_version = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.barbican_endpoint = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.barbican_endpoint_type = public {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.barbican_region_name = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.number_of_retries = 60 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.retry_delay = 1 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.send_service_user_token = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.verify_ssl = True {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican.verify_ssl_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.auth_section = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.auth_type = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.cafile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.certfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.collect_timing = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.insecure = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.keyfile = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.split_loggers = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] barbican_service_user.timeout = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.approle_role_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.approle_secret_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.kv_mountpoint = secret {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.kv_path = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.kv_version = 2 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.namespace = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.root_token_id = **** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.ssl_ca_crt_file = None {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.timeout = 60.0 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.use_ssl = False {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:35:24 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] ******************************************************************************** {{(pid=75996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:35:25 devstack sudo[76161]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.753s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[76242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:25 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:25 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.641s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:35:25 devstack cinder-volume[76157]: INFO cinder.brick.local_dev.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[76501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:25 devstack sudo[76501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:26 devstack sudo[76501]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.853s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:26 devstack cinder-volume[76157]: DEBUG cinder.brick.local_dev.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76157) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 18:35:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:26 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:26 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:27 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.176s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:27 devstack sudo[76935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:27 devstack sudo[76935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:28 devstack sudo[76935]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:28 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 18:35:28 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:29 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:29 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.852s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:29 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:29 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:29 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:30 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:30 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.884s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:30 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:30 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:30 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:31 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:31 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.880s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:31 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:31 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:31 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:32 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.879s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:32 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:32 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:32 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:32 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:32 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:32 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:33 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:33 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.740s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:33 devstack cinder-volume[76157]: INFO cinder.volume.drivers.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 18:35:33 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:33 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:33 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:33 devstack sudo[77097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:33 devstack sudo[77097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:34 devstack sudo[77097]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:34 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:34 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:35:34 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:34 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:34 devstack sudo[77109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:34 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:34 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:34 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:34 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:34 devstack sudo[77243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:34 devstack sudo[77243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:35 devstack sudo[77243]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:35 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:35 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:35 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:35 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:36 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:36 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:36 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:36 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:36 devstack cinder-volume[76157]: INFO cinder.volume.driver [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG cinder.volume.driver [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76157) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76157) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writer thread running {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG cinder.db.api [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Building query based on filter {{(pid=76157) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG cinder.image.image_utils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76157) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:35:36 devstack cinder-volume[76157]: INFO cinder.keymgr.migration [None req-82e554ed-7bbc-4592-973a-813b103ed159 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:35:36 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:36 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:36 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:37 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:37 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:38 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:38 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:38 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:38 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:38 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:38 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:38 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:38 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:39 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:39 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Driver initialization completed successfully. Jul 08 18:35:39 devstack cinder-volume[76157]: INFO cinder.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Initiating service 2 cleanup Jul 08 18:35:39 devstack cinder-volume[76157]: INFO cinder.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Service 2 cleanup completed. Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG cinder.service [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Creating RPC server for service cinder-volume {{(pid=76157) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG cinder.service [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76157) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:35:39 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:35:39 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:39 devstack sudo[77275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:35:39 devstack sudo[77275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:40 devstack sudo[77275]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:40 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:40 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:40 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:40 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:41 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:41 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.771s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:41 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:41 devstack sudo[77282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:35:41 devstack sudo[77282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:41 devstack sudo[77282]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:41 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:41 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:42 devstack sudo[77339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:35:42 devstack sudo[77339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:42 devstack sudo[77339]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:42 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:42 devstack cinder-volume[76157]: INFO cinder.volume.manager [None req-2a8b1a68-e820-4e2c-b79e-645ac048146c None None] Driver post RPC initialization completed successfully. Jul 08 18:35:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:36:25 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:25 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:36:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:25 devstack sudo[78889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:36:25 devstack sudo[78889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:26 devstack sudo[78889]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:26 devstack sudo[78957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:36:26 devstack sudo[78957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:27 devstack sudo[78957]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:27 devstack sudo[78960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:36:27 devstack sudo[78960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:27 devstack sudo[78960]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:27 devstack sudo[78963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:36:27 devstack sudo[78963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:28 devstack sudo[78963]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:28 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:28 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:36:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread info: [<_MainThread(MainThread, started 135277408710784)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:37:25 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:37:25 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:37:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:25 devstack sudo[82259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:37:25 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:26 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:26 devstack sudo[82263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:37:26 devstack sudo[82263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:27 devstack sudo[82263]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:27 devstack sudo[82266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:37:27 devstack sudo[82266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:27 devstack sudo[82266]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:27 devstack sudo[82269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:37:27 devstack sudo[82269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:28 devstack sudo[82269]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:28 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:37:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:38:25 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:38:25 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:38:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:25 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:38:25 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:26 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:26 devstack sudo[84091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:38:26 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:27 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:27 devstack sudo[84096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:38:27 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:27 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:38:27 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:38:27 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:38:28 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Jul 08 18:38:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:38:28 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:38:28 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:38:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:38:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread info: [<_MainThread(MainThread, started 135277408710784)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:39:25 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:39:25 devstack cinder-volume[76157]: DEBUG cinder.volume.drivers.lvm [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Updating volume stats {{(pid=76157) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:39:25 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:25 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:39:25 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:26 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:26 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:26 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:39:26 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:27 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:27 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:39:27 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:27 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:27 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:39:27 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:39:27 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:39:28 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Jul 08 18:39:28 devstack cinder-volume[76157]: DEBUG oslo_concurrency.processutils [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76157) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:39:28 devstack cinder-volume[76157]: DEBUG cinder.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Notifying Schedulers of capabilities ... {{(pid=76157) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:39:28 devstack cinder-volume[76157]: DEBUG oslo_service.periodic_task [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] Running periodic task VolumeManager._thread_info {{(pid=76157) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:39:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread count: 6 {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:39:28 devstack cinder-volume[76157]: DEBUG cinder.volume.manager [None req-b612d7cf-ff88-4691-b95b-088695ca31eb None None] thread info: [<_MainThread(MainThread, started 135277408710784)>, , , , , ] {{(pid=76157) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:39:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:SELECT=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:39:52 devstack cinder-volume[76157]: DEBUG dbcounter [-] [76157] Writing DB stats cinder:UPDATE=1 {{(pid=76157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:40:06 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Caught SIGTERM, stopping children Jul 08 18:40:06 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Acquiring lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:06 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Acquired lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:06 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Releasing lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:06 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Stop services. {{(pid=75996) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:40:06 devstack cinder-volume[75996]: DEBUG oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Killing children. {{(pid=75996) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:40:06 devstack cinder-volume[75996]: INFO oslo_service.backend._eventlet.service [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Waiting on 1 children to exit Jul 08 18:40:11 devstack cinder-volume[76157]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 18:40:12 devstack cinder-volume[86323]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:40:12 devstack cinder-volume[86323]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:40:12 devstack cinder-volume[86323]: we strongly recommend against using it for new projects. Jul 08 18:40:12 devstack cinder-volume[86323]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:40:12 devstack cinder-volume[86323]: framework. For more detail see Jul 08 18:40:12 devstack cinder-volume[86323]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:40:12 devstack cinder-volume[86323]: import eventlet # noqa Jul 08 18:40:14 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:14 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:14 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Acquiring lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Acquired lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:14 devstack cinder-volume[76157]: DEBUG oslo_concurrency.lockutils [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Releasing lock "singleton_lock" {{(pid=76157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:14 devstack cinder-volume[76157]: WARNING amqp [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:40:14 devstack cinder-volume[76157]: WARNING amqp [None req-03ab078a-9088-40a2-b0ed-232d8e9528bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:40:15 devstack cinder-volume[86323]: INFO dbcounter [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Registered counter for database cinder Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_db.sqlalchemy.engines [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG dbcounter [-] [86323] Writer thread running {{(pid=86323) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:40:15 devstack cinder-volume[86323]: INFO cinder.rpc [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:40:15 devstack cinder-volume[86323]: INFO cinder.rpc [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_db.sqlalchemy.engines [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:15 devstack cinder-volume[86323]: INFO cinder.volume.manager [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Determined volume DB was empty at startup. Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG cinder.volume.manager [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86323) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:40:15 devstack cinder-volume[86323]: INFO cinder.volume.manager [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:40:15 devstack cinder-volume[86323]: WARNING stevedore.named [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:40:15 devstack cinder-volume[86323]: WARNING castellan.key_manager [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:40:15 devstack cinder-volume[86323]: WARNING cinder.keymgr.conf_key_mgr [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:40:15 devstack cinder-volume[86323]: INFO cinder.volume.manager [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_db.sqlalchemy.engines [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:15 devstack cinder-volume[86323]: INFO oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Starting 1 workers Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Started child 86601 {{(pid=86323) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Full set of CONF: {{(pid=86323) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] ******************************************************************************** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Configuration options gathered from: {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] ================================================================================ {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] allow_availability_zone_fallback = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] allow_compression_on_image_upload = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] allowed_direct_url_schemes = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] api_rate_limit = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86601]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] auth_strategy = keystone {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_availability_zone = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_host = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_stats_polling_interval = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backup_api_class = cinder.backup.api.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backup_name_template = backup-%s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backup_use_same_host = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backup_use_temp_snapshot = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] chap_password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] chap_username = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_internal_tenant_project_id = 8b03f18378d24131bbb52179c84e6977 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_internal_tenant_user_id = 29c69d5afc9f4b25bc59735fabd3ae38 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cluster = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] compression_format = gzip {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] config_dir = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] config_source = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] control_exchange = openstack {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] debug = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] default_availability_zone = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] default_group_type = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] default_volume_type = QuobyteHD {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] disk_geometry = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_client_cert = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_client_cert_key = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_data_namespace = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_ssl_cert_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_ssl_cert_verify = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] driver_use_ssl = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] enable_new_services = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] enable_unsupported_driver = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] enforce_multipath_for_image_xfer = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] filter_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_api_insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_api_servers = ['http://192.168.122.204/image'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_api_ssl_compression = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_ca_certificates_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_num_retries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance_request_timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] goodness_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] graceful_shutdown_timeout = 5 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] group_api_class = cinder.group.api.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] host = devstack {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_compress_on_upload = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_conversion_address_space_limit = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_conversion_cpu_limit = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_conversion_disable = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_upload_use_cinder_backend = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_upload_use_internal_tenant = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_volume_cache_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_volume_cache_max_count = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] init_host_max_objects_retrieval = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] instance_format = [instance: %(uuid)s] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iscsi_target_flags = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iscsi_write_cache = on {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iser_helper = tgtadm {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:15 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iser_ip_address = 192.168.122.204 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iser_port = 3260 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_color = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_config_append = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_dir = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_options = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_rotate_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_rotate_interval_type = days {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] log_rotation_type = none {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] max_age = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] max_logfile_count = 30 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] max_logfile_size_mb = 200 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] max_over_subscription_ratio = 20.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] message_reap_interval = 86400 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] message_ttl = 2592000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] monkey_patch = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] monkey_patch_modules = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] my_ip = 192.168.122.204 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] no_snapshot_gb_quota = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] num_iser_scan_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] num_shell_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] num_volume_device_scan_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] nvmeof_conn_info_version = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] nvmet_ns_id = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] nvmet_port_id = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_max_limit = 1000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_ext_list = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_listen_port = 8776 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_use_ssl = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] osapi_volume_workers = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] per_volume_size_limit = -1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] periodic_fuzzy_delay = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] periodic_interval = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] public_endpoint = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] publish_errors = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_backup_gigabytes = 1000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86601]: INFO cinder.volume.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.remotefs [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86601) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_backups = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_gigabytes = 1000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_groups = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_snapshots = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] quota_volumes = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] rate_limit_burst = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] rate_limit_except_level = CRITICAL {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] rate_limit_interval = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] reinit_driver_count = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] replication_device = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] report_discard_supported = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] report_interval = 120 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] reservation_clean_interval = 86400 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] reservation_expire = 86400 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] reserved_image_namespaces = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] reserved_percentage = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] rpc_response_timeout = 120 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] run_external_periodic_tasks = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] scst_target_driver = iscsi {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] scst_target_iqn_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_down_time = 720 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] shell_completion = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] snapshot_name_template = snapshot-%s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] split_loggers = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] state_path = /opt/stack/data/cinder {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] storage_availability_zone = nova {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] storage_protocol = iSCSI {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] syslog_log_facility = LOG_USER {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_helper = lioadm {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_ip_address = 192.168.122.204 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_port = 3260 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_protocol = iscsi {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] target_secondary_ip_addresses = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] trace_flags = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] transport_url = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] until_refresh = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_chap_auth = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_default_quota_class = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_journal = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_json = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_multipath_for_image_xfer = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_stderr = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] use_syslog = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] verify_glance_signatures = enabled {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_api_class = cinder.volume.api.API {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_backend_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_clear = zero {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_clear_ionice = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_clear_size = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_copy_bps_limit = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_dd_blocksize = 1M {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_name_template = volume-%s {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_service_inithost_offload = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volume_usage_audit_period = month {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] zoning_mode = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.auth_section = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.auth_type = password {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.auth_version = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.cache = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.interface = public {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_password = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcache_username = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.region_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.service_type = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.backend = dogpile.cache.null {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.backend_argument = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.backend_expiration_time = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.config_prefix = cache.oslo {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.debug_cache_backend = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.enable_retry_client = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.enable_socket_keepalive = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.expiration_time = 600 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_dead_retry = 300 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_sasl_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.proxies = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86601) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:40:16 devstack cinder-volume[86601]: WARNING cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:40:16 devstack cinder-volume[86601]: WARNING cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.redis_db = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.redis_server = localhost:6379 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.retry_attempts = 2 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.retry_delay = 0.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Running cmd (subprocess): mount.quobyte {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.socket_keepalive_count = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.socket_keepalive_idle = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.socket_keepalive_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.socket_timeout = 1.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.tls_allowed_ciphers = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.tls_cafile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.tls_certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.tls_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.tls_keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cache.username = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] coordination.backend_url = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.asyncio_connection = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.asyncio_slave_connection = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.backend = sqlalchemy {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.connection = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.connection_debug = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.connection_parameters = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.connection_recycle_time = 3600 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.connection_trace = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.db_inc_retry_interval = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.db_max_retries = 20 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.db_max_retry_interval = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.db_retry_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.max_overflow = 50 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.max_pool_size = 5 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.max_retries = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.pool_timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.retry_interval = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.slave_connection = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.sqlite_synchronous = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.synchronous_reader = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] database.use_db_reconnect = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.connection_string = messaging:// {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.es_doc_type = notification {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.es_scroll_size = 10000 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.es_scroll_time = 2m {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.filter_error_trace = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.hmac_keys = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.sentinel_service_name = mymaster {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.socket_timeout = 0.1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.trace_requests = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler.trace_sqlalchemy = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler_jaeger.process_tags = {} {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] profiler_otlp.service_name_prefix = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.enforce_scope = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.policy_default_rule = default {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.group = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.helper_command = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] privsep_osbrick.user = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.group = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.helper_command = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] cinder_sys_admin.user = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.auth_section = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.auth_type = password {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.cafile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.collect_timing = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.send_service_user_token = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.split_loggers = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] service_user.timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.auth_section = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.auth_type = password {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.collect_timing = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.region_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.split_loggers = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] glance.timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.backend_availability_zone = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.chap_password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.chap_username = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.disk_geometry = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_client_cert = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_data_namespace = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.driver_use_ssl = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.extra_capabilities = {} {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.filter_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.goodness_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iscsi_target_flags = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack quobyte-client[86604]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 18:40:16 devstack quobyte-client[86604]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iser_port = 3260 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_host = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=86601) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_login = admin {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_mount_options = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_private_key = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86601]: INFO cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf ... Jul 08 18:40:16 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a -c /etc/quobyte/client-cinder.cfg {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_share_path = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.replication_device = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.report_discard_supported = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_helper = tgtadm {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_port = 3260 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_protocol = iscsi {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.trace_flags = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.use_chap_auth = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_backend_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_clear = zero {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_reports.file_event_handler = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_reports.log_dir = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.backend_host = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.chap_password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.chap_username = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.disk_geometry = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_client_cert = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.extra_capabilities = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.filter_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.goodness_function = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iser_helper = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iser_ip_address = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iser_port = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_host = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_login = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_mount_options = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_password = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_private_key = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_share_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.num_shell_tries = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.replication_device = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.report_discard_supported = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.reserved_percentage = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.scst_target_driver = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.storage_protocol = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_helper = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_ip_address = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_port = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_prefix = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_protocol = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.trace_flags = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.use_chap_auth = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a -c /etc/quobyte/client-cinder.cfg Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_clear = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_clear_size = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] QuobyteHD.volumes_dir = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_notifications.driver = [] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] key_manager.fixed_key = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.barbican_api_version = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.barbican_endpoint = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.barbican_endpoint_type = public {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.barbican_region_name = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.cafile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.collect_timing = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.number_of_retries = 60 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.retry_delay = 1 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.send_service_user_token = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.split_loggers = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.verify_ssl = True {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican.verify_ssl_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.auth_section = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.auth_type = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.cafile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.certfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.collect_timing = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.insecure = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.keyfile = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.split_loggers = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] barbican_service_user.timeout = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.approle_role_id = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.approle_secret_id = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.kv_mountpoint = secret {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.kv_path = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.kv_version = 2 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.namespace = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.root_token_id = **** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.ssl_ca_crt_file = None {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.timeout = 60.0 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.use_ssl = False {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:16 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] ******************************************************************************** {{(pid=86323) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:40:17 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.890s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:17 devstack cinder-volume[86601]: INFO cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf succeeded Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=86601) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.907s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:17 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:17 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:17 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.769s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:17 devstack cinder-volume[86601]: INFO cinder.volume.driver [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:40:17 devstack cinder-volume[86601]: DEBUG cinder.volume.driver [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7276611328125, 'free_capacity_gb': 1775.7276611328125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86601) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG oslo_db.sqlalchemy.engines [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86601) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG dbcounter [-] [86601] Writer thread running {{(pid=86601) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG cinder.db.api [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Building query based on filter {{(pid=86601) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG cinder.image.image_utils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86601) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:40:18 devstack cinder-volume[86601]: INFO cinder.keymgr.migration [None req-335bfa39-6850-4850-b345-8a97a83b6f36 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=86601) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=86601) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:18 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:18 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:18 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:19 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.918s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG cinder.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Notifying Schedulers of capabilities ... {{(pid=86601) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:40:19 devstack cinder-volume[86601]: INFO cinder.volume.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Driver initialization completed successfully. Jul 08 18:40:19 devstack cinder-volume[86601]: INFO cinder.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Initiating service 3 cleanup Jul 08 18:40:19 devstack cinder-volume[86601]: INFO cinder.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Service 3 cleanup completed. Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG cinder.service [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Creating RPC server for service cinder-volume {{(pid=86601) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG cinder.service [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86601) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:40:19 devstack cinder-volume[86601]: INFO cinder.volume.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=86601) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=86601) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:19 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:19 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:19 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:20 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:20 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.717s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:20 devstack cinder-volume[86601]: INFO cinder.volume.manager [None req-281b43b7-d70d-4adb-a5ac-32ceb2d2bc79 None None] Driver post RPC initialization completed successfully. Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=86601) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG cinder.volume.drivers.quobyte [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=86601) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86601) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:22 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:22 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:22 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:22 devstack cinder-volume[86323]: INFO oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Caught SIGTERM, stopping children Jul 08 18:40:22 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Acquiring lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:22 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Acquired lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:22 devstack cinder-volume[86323]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Releasing lock "singleton_lock" {{(pid=86323) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:22 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Stop services. {{(pid=86323) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:40:22 devstack cinder-volume[86323]: DEBUG oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Killing children. {{(pid=86323) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:40:22 devstack cinder-volume[86323]: INFO oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Waiting on 1 children to exit Jul 08 18:40:23 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Acquiring lock "singleton_lock" {{(pid=86601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:23 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Acquired lock "singleton_lock" {{(pid=86601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:23 devstack cinder-volume[86601]: DEBUG oslo_concurrency.lockutils [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Releasing lock "singleton_lock" {{(pid=86601) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:23 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:23 devstack cinder-volume[86601]: DEBUG oslo_concurrency.processutils [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.965s {{(pid=86601) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:23 devstack cinder-volume[86601]: DEBUG cinder.manager [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Notifying Schedulers of capabilities ... {{(pid=86601) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Unable to connect to AMQP server on 192.168.122.204:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server [None req-4f19392a-2c1e-411c-9cc5-d7c07b9d869d None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.204:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1139, in ensure Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1128, in execute_method Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server method() Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1590, in _publish Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self._producer.publish( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return _publish( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server listener(*args) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server raise error_for_code( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1709, in fanout_send Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1539, in _ensure_publishing Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1161, in ensure Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.204:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Jul 08 18:40:23 devstack cinder-volume[86601]: ERROR oslo_messaging.rpc.server Jul 08 18:40:23 devstack cinder-volume[86601]: WARNING amqp [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:40:23 devstack cinder-volume[86601]: WARNING amqp [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:40:23 devstack cinder-volume[86323]: INFO oslo_service.backend._eventlet.service [None req-4e3eacb9-a078-45ab-8e72-66c641b46ba8 None None] Child 86601 exited with status 0 Jul 08 18:40:24 devstack cinder-volume[86988]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:40:24 devstack cinder-volume[86988]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:40:24 devstack cinder-volume[86988]: we strongly recommend against using it for new projects. Jul 08 18:40:24 devstack cinder-volume[86988]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:40:24 devstack cinder-volume[86988]: framework. For more detail see Jul 08 18:40:24 devstack cinder-volume[86988]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:40:24 devstack cinder-volume[86988]: import eventlet # noqa Jul 08 18:40:26 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:40:26 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:40:26 devstack cinder-volume[86988]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:40:28 devstack cinder-volume[86988]: INFO dbcounter [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Registered counter for database cinder Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG dbcounter [-] [86988] Writer thread running {{(pid=86988) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:40:28 devstack cinder-volume[86988]: INFO cinder.rpc [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:40:28 devstack cinder-volume[86988]: INFO cinder.rpc [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:28 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Determined volume DB was empty at startup. Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG cinder.volume.manager [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86988) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:40:28 devstack cinder-volume[86988]: WARNING stevedore.named [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:40:28 devstack cinder-volume[86988]: WARNING castellan.key_manager [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:40:28 devstack cinder-volume[86988]: WARNING cinder.keymgr.conf_key_mgr [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:40:28 devstack cinder-volume[86988]: INFO cinder.volume.manager [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:28 devstack cinder-volume[86988]: INFO oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Starting 1 workers Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Started child 87229 {{(pid=86988) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Full set of CONF: {{(pid=86988) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] ******************************************************************************** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] Configuration options gathered from: {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] ================================================================================ {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] allow_availability_zone_fallback = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] allow_compression_on_image_upload = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] allowed_direct_url_schemes = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] api_rate_limit = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] auth_strategy = keystone {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_availability_zone = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_host = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[87229]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_stats_polling_interval = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backup_api_class = cinder.backup.api.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backup_name_template = backup-%s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backup_use_same_host = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backup_use_temp_snapshot = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] chap_password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] chap_username = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_internal_tenant_project_id = 8b03f18378d24131bbb52179c84e6977 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_internal_tenant_user_id = 29c69d5afc9f4b25bc59735fabd3ae38 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cluster = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] compression_format = gzip {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] config_dir = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] config_source = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] control_exchange = openstack {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] debug = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] default_availability_zone = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] default_group_type = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] default_volume_type = QuobyteHD {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] disk_geometry = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_client_cert = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:28 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_client_cert_key = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_data_namespace = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_ssl_cert_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_ssl_cert_verify = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] driver_use_ssl = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] enable_new_services = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] enable_unsupported_driver = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] enforce_multipath_for_image_xfer = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] filter_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_api_insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_api_servers = ['http://192.168.122.204/image'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_api_ssl_compression = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_ca_certificates_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_num_retries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance_request_timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] goodness_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] graceful_shutdown_timeout = 5 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] group_api_class = cinder.group.api.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] host = devstack {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_compress_on_upload = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_conversion_address_space_limit = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_conversion_cpu_limit = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_conversion_disable = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_upload_use_cinder_backend = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_upload_use_internal_tenant = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_volume_cache_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_volume_cache_max_count = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] init_host_max_objects_retrieval = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] instance_format = [instance: %(uuid)s] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iscsi_target_flags = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iscsi_write_cache = on {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iser_helper = tgtadm {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iser_ip_address = 192.168.122.204 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iser_port = 3260 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_color = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_config_append = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_dir = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_options = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_rotate_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_rotate_interval_type = days {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] log_rotation_type = none {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] max_age = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] max_logfile_count = 30 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] max_logfile_size_mb = 200 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] max_over_subscription_ratio = 20.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] message_reap_interval = 86400 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] message_ttl = 2592000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] monkey_patch = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] monkey_patch_modules = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] my_ip = 192.168.122.204 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] no_snapshot_gb_quota = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] num_iser_scan_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] num_shell_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] num_volume_device_scan_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] nvmeof_conn_info_version = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] nvmet_ns_id = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] nvmet_port_id = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_max_limit = 1000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_ext_list = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_listen_port = 8776 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_use_ssl = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] osapi_volume_workers = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] per_volume_size_limit = -1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] periodic_fuzzy_delay = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] periodic_interval = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] public_endpoint = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] publish_errors = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_backup_gigabytes = 1000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_backups = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_gigabytes = 1000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_groups = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_snapshots = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] quota_volumes = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] rate_limit_burst = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] rate_limit_except_level = CRITICAL {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] rate_limit_interval = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] reinit_driver_count = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] replication_device = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] report_discard_supported = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] report_interval = 120 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] reservation_clean_interval = 86400 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] reservation_expire = 86400 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] reserved_image_namespaces = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] reserved_percentage = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87229) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] rpc_response_timeout = 120 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] run_external_periodic_tasks = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] scst_target_driver = iscsi {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] scst_target_iqn_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_down_time = 720 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] shell_completion = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] snapshot_name_template = snapshot-%s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] split_loggers = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] state_path = /opt/stack/data/cinder {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] storage_availability_zone = nova {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] storage_protocol = iSCSI {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] syslog_log_facility = LOG_USER {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_helper = lioadm {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_ip_address = 192.168.122.204 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_port = 3260 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_protocol = iscsi {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] target_secondary_ip_addresses = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] trace_flags = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] transport_url = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] until_refresh = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_chap_auth = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_default_quota_class = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_journal = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_json = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_multipath_for_image_xfer = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_stderr = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] use_syslog = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] verify_glance_signatures = enabled {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_api_class = cinder.volume.api.API {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_backend_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_clear = zero {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_clear_ionice = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_clear_size = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_copy_bps_limit = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_dd_blocksize = 1M {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_name_template = volume-%s {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_service_inithost_offload = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volume_usage_audit_period = month {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] zoning_mode = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.auth_section = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.auth_type = password {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.auth_version = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.cache = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.interface = public {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_password = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcache_username = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.region_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.service_type = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.204/identity {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.backend = dogpile.cache.null {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.backend_argument = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.backend_expiration_time = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.config_prefix = cache.oslo {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.debug_cache_backend = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.enable_retry_client = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.enable_socket_keepalive = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.expiration_time = 600 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_dead_retry = 300 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_sasl_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.proxies = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.redis_db = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.redis_server = localhost:6379 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.retry_attempts = 2 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.retry_delay = 0.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.socket_keepalive_count = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.socket_keepalive_idle = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.socket_keepalive_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.socket_timeout = 1.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.tls_allowed_ciphers = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.tls_cafile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.tls_certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.tls_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.tls_keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cache.username = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] coordination.backend_url = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.asyncio_connection = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.asyncio_slave_connection = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.backend = sqlalchemy {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.connection = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.connection_debug = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.connection_parameters = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.connection_recycle_time = 3600 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.connection_trace = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.db_inc_retry_interval = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.db_max_retries = 20 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.db_max_retry_interval = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.db_retry_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.max_overflow = 50 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.max_pool_size = 5 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.max_retries = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.pool_timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.retry_interval = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.slave_connection = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.sqlite_synchronous = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.synchronous_reader = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] database.use_db_reconnect = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87229) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:40:29 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:40:29 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.connection_string = messaging:// {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Running cmd (subprocess): mount.quobyte {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.es_doc_type = notification {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.es_scroll_size = 10000 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.es_scroll_time = 2m {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.filter_error_trace = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.hmac_keys = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.sentinel_service_name = mymaster {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.socket_timeout = 0.1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.trace_requests = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler.trace_sqlalchemy = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler_jaeger.process_tags = {} {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] profiler_otlp.service_name_prefix = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.enforce_scope = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.policy_default_rule = default {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.group = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.helper_command = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] privsep_osbrick.user = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.group = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.helper_command = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] cinder_sys_admin.user = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.auth_section = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.auth_type = password {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.cafile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.collect_timing = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.send_service_user_token = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.split_loggers = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] service_user.timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.auth_section = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.auth_type = password {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.collect_timing = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.region_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.split_loggers = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] glance.timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.backend_availability_zone = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.chap_password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.chap_username = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.disk_geometry = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_client_cert = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_data_namespace = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.driver_use_ssl = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.extra_capabilities = {} {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.filter_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.goodness_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iscsi_target_flags = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iser_ip_address = 192.168.122.204 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iser_port = 3260 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_host = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_login = admin {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_mount_options = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_private_key = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_share_path = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.replication_device = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.report_discard_supported = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_helper = tgtadm {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_ip_address = 192.168.122.204 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_port = 3260 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_protocol = iscsi {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.trace_flags = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.use_chap_auth = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_backend_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_clear = zero {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_reports.file_event_handler = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_reports.log_dir = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.backend_host = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.chap_password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.chap_username = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.disk_geometry = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_client_cert = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.extra_capabilities = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.filter_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.goodness_function = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iser_helper = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iser_ip_address = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iser_port = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_host = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_login = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_mount_options = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_password = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_private_key = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:29 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_share_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.num_shell_tries = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.replication_device = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.report_discard_supported = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.reserved_percentage = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.scst_target_driver = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.storage_protocol = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_helper = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_ip_address = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_port = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_prefix = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_protocol = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.trace_flags = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.use_chap_auth = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_clear = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_clear_size = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] QuobyteHD.volumes_dir = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_notifications.driver = [] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] key_manager.fixed_key = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.barbican_api_version = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.barbican_endpoint = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.barbican_endpoint_type = public {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.barbican_region_name = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.cafile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.collect_timing = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.number_of_retries = 60 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.retry_delay = 1 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.send_service_user_token = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.split_loggers = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.verify_ssl = True {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican.verify_ssl_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.auth_section = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.auth_type = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.cafile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.certfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.collect_timing = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.insecure = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.keyfile = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.split_loggers = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] barbican_service_user.timeout = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.approle_role_id = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.approle_secret_id = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.kv_mountpoint = secret {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.kv_path = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.kv_version = 2 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.namespace = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.root_token_id = **** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.ssl_ca_crt_file = None {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.timeout = 60.0 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.use_ssl = False {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:40:30 devstack cinder-volume[86988]: DEBUG oslo_service.backend._eventlet.service [None req-ec6fb8e4-dac0-4c5b-86ce-a28d621f4ca0 None None] ******************************************************************************** {{(pid=86988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.140s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:30 devstack cinder-volume[87229]: INFO cinder.volume.driver [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG cinder.volume.driver [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7276611328125, 'free_capacity_gb': 1775.7276611328125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87229) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:40:30 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_db.sqlalchemy.engines [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writer thread running {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG cinder.db.api [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Building query based on filter {{(pid=87229) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87229) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:30 devstack cinder-volume[87229]: INFO cinder.keymgr.migration [None req-dbb4c0af-b374-48cd-9667-de93fd6996ab None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:40:30 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:30 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:31 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.722s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:40:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Driver initialization completed successfully. Jul 08 18:40:31 devstack cinder-volume[87229]: INFO cinder.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Initiating service 3 cleanup Jul 08 18:40:31 devstack cinder-volume[87229]: INFO cinder.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Service 3 cleanup completed. Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG cinder.service [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Creating RPC server for service cinder-volume {{(pid=87229) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG cinder.service [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87229) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:40:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:40:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:40:31 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:40:31 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:40:32 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Jul 08 18:40:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:40:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-91332567-5cf9-452d-8bfd-819ffb6e9d85 None None] Driver post RPC initialization completed successfully. Jul 08 18:40:38 devstack cinder-volume[86988]: DEBUG dbcounter [-] [86988] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86988) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:40:41 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:40:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:41:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:41:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 6 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:41:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Flow 'volume_create_manager' (12a89471-4950-4edb-ba97-dde57c4a43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5a9f12-be6a-4f2a-9230-c37f15906bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5a9f12-be6a-4f2a-9230-c37f15906bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1811032298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44042db4-13e4-4d3d-b58b-7ba9c6af2bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b26bbdcd033419c908fa7c14a3c6e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:02Z,use_quota=True,user_id='19e1690df7b8414eaa7d6baff07874ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178a539-621f-4a9a-84d0-a934ff7d6d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178a539-621f-4a9a-84d0-a934ff7d6d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16619d-e820-4b9e-b88c-e05dcdf630e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16619d-e820-4b9e-b88c-e05dcdf630e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44042db4-13e4-4d3d-b58b-7ba9c6af2bd7', 'volume_name': 'volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02948484-6398-4ca8-a11f-7a10ecb785bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02948484-6398-4ca8-a11f-7a10ecb785bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0674bb-1b9a-43d7-a6c3-628befbf0b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:02 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Volume 44042db4-13e4-4d3d-b58b-7ba9c6af2bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7', 'volume_size': 1} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1811032298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44042db4-13e4-4d3d-b58b-7ba9c6af2bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b26bbdcd033419c908fa7c14a3c6e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:02Z,use_quota=True,user_id='19e1690df7b8414eaa7d6baff07874ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Creating volume 44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:02 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:42:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:02 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 1073741824 Jul 08 18:42:02 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:04 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 1073741824" returned: 0 in 1.742s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:04 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 Jul 08 18:42:04 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:05 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" returned: 0 in 0.929s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] <== create_volume: return (2756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.759s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0674bb-1b9a-43d7-a6c3-628befbf0b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a195b73-029c-47bf-9afe-fd6aa3ce07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Volume volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 (44042db4-13e4-4d3d-b58b-7ba9c6af2bd7): created successfully Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a195b73-029c-47bf-9afe-fd6aa3ce07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Flow 'volume_create_manager' (12a89471-4950-4edb-ba97-dde57c4a43f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bb4b130f-de0f-4960-a4df-c7db5af5c2df tempest-VolumesAdminNegativeTest-1495643140 None] Created volume successfully. Jul 08 18:42:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Acquiring lock "cinder-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "cinder-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Acquiring lock "cinder-quobyte-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "cinder-quobyte-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" acquired by "delete_volume" :: waited 0.043s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:07 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1mvi5c7k/privsep.sock'] Jul 08 18:42:07 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1mvi5c7k/privsep.sock Jul 08 18:42:07 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:42:09 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:42:10 devstack cinder-volume[87229]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 18:42:12 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:12 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Spawned new privsep daemon via rootwrap Jul 08 18:42:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Accepted privsep connection to /tmp/tmp1mvi5c7k/privsep.sock {{(pid=87229) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 18:42:12 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 18:42:12 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 18:42:12 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 18:42:12 devstack cinder-volume[87229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88383 Jul 08 18:42:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[150977ee-a006-4528-84f2-147ed2f9bcec]: (2,) {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b729ea-9f4b-4ee3-86c2-ba973fcd9fda]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:12 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 Jul 08 18:42:12 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Flow 'volume_create_manager' (cd157a1c-a796-4350-8431-ffb825ec6138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22cf36f-5846-49b8-9a0a-057e85e8ad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22cf36f-5846-49b8-9a0a-057e85e8ad87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1276055771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa3bb6e-fedb-4f61-98d2-535d408a2dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf697fec79f64850af1179d48b3cef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:13Z,use_quota=True,user_id='2f926749a910477fa11e0e2d40d590a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e069f5-9b75-4bda-8050-73d0aa7260ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:13 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e069f5-9b75-4bda-8050-73d0aa7260ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c05ef-01c1-4d0f-8318-b7014c34b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77c05ef-01c1-4d0f-8318-b7014c34b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa3bb6e-fedb-4f61-98d2-535d408a2dab', 'volume_name': 'volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec63b118-a250-4703-b88e-d9d5f0e4da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec63b118-a250-4703-b88e-d9d5f0e4da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdf2494-76ea-4001-bfea-e05ccb1a3009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Volume caa3bb6e-fedb-4f61-98d2-535d408a2dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab', 'volume_size': 1} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1276055771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa3bb6e-fedb-4f61-98d2-535d408a2dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf697fec79f64850af1179d48b3cef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:13Z,use_quota=True,user_id='2f926749a910477fa11e0e2d40d590a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Creating volume caa3bb6e-fedb-4f61-98d2-535d408a2dab {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:13 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" returned: 0 in 1.417s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:13 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab 1073741824 Jul 08 18:42:13 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:13 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7 Jul 08 18:42:13 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:14 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" returned: 0 in 1.046s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "cinder-quobyte-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7" released by "delete_volume" :: held 6.884s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:14 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:42:14 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Created reservations ['32998832-972f-47c6-9320-c872e81c0910', 'd21ac51c-ccc7-4ccc-a25b-92ccd7b2edaa', 'ee0fc01d-8cea-4380-8ac1-c23d305f5600', 'f27097e3-10b4-41b0-bd7e-7ac061ac9abc'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:14 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:42:14 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:15 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab 1073741824" returned: 0 in 1.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:15 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab Jul 08 18:42:15 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:17 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab" returned: 0 in 1.642s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] <== create_volume: return (3551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.560s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdf2494-76ea-4001-bfea-e05ccb1a3009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90558a73-71ed-4eb2-8ca0-9ab7425625f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:17 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 2.213s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Deleted volume successfully. Jul 08 18:42:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Volume volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab (caa3bb6e-fedb-4f61-98d2-535d408a2dab): created successfully Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90558a73-71ed-4eb2-8ca0-9ab7425625f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Flow 'volume_create_manager' (cd157a1c-a796-4350-8431-ffb825ec6138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-777f2572-33e3-40d4-bbad-82260c923cdb tempest-ServerRescueNegativeTestJSON-1641759664 None] Created volume successfully. Jul 08 18:42:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e77d8095-5ec9-4dbe-a860-7ae0cee3800f tempest-VolumesAdminNegativeTest-1495643140 None] Lock "cinder-44042db4-13e4-4d3d-b58b-7ba9c6af2bd7-delete_volume" released by "delete_volume" :: held 9.785s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:18 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:42:18 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:19 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.342s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:42:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 8 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:42:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:42:27 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:42:27 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Flow 'volume_create_manager' (c18fd1e1-d67b-47e2-8191-5f2c39524ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c705f8-274c-43e8-b106-9803a17d0bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c705f8-274c-43e8-b106-9803a17d0bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1372877042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845d444e-c5da-42d0-91ec-9cc3b011f5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3874cd5cad3f4d4a9b0562965a6a32de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:39Z,use_quota=True,user_id='8abee2c06a0e461ab04902bfd7536e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaaa52c-10ae-4381-acc6-3faf2657ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaaa52c-10ae-4381-acc6-3faf2657ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e7f75a-dae8-4e94-9f12-7d1c950f7784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e7f75a-dae8-4e94-9f12-7d1c950f7784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'volume_name': 'volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7757be59-398c-4b94-8797-a8cdf9a7c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7757be59-398c-4b94-8797-a8cdf9a7c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eecba0-5207-4f29-919d-50828d3e78b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Volume 845d444e-c5da-42d0-91ec-9cc3b011f5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'volume_size': 1} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1372877042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845d444e-c5da-42d0-91ec-9cc3b011f5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3874cd5cad3f4d4a9b0562965a6a32de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:39Z,use_quota=True,user_id='8abee2c06a0e461ab04902bfd7536e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Creating volume 845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:39 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:42:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:39 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa 1073741824 Jul 08 18:42:39 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:40 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa 1073741824" returned: 0 in 1.414s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:40 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa Jul 08 18:42:40 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:41 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa" returned: 0 in 0.914s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eecba0-5207-4f29-919d-50828d3e78b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3230c9d-3f69-4d9a-b12c-42dadf09a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Flow 'volume_create_manager' (7e634a3e-fa87-48ec-8937-18d609c583ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f23e2-7237-4fe5-b542-d58f07b19c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Volume volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa (845d444e-c5da-42d0-91ec-9cc3b011f5aa): created successfully Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3230c9d-3f69-4d9a-b12c-42dadf09a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Flow 'volume_create_manager' (c18fd1e1-d67b-47e2-8191-5f2c39524ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f23e2-7237-4fe5-b542-d58f07b19c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-262429310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9181ed76-6ae4-4b09-89ae-56a04c975156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6eed773857748a0854a77afb0f83323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:41Z,use_quota=True,user_id='84d53a9a71044156853639d222da3ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a88a265-4062-4f92-9077-fbe6cb45944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a88a265-4062-4f92-9077-fbe6cb45944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597c554-4cd0-4a82-9115-2d2903163412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597c554-4cd0-4a82-9115-2d2903163412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9181ed76-6ae4-4b09-89ae-56a04c975156', 'volume_name': 'volume-9181ed76-6ae4-4b09-89ae-56a04c975156', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29ac5e-adcf-49bd-ad25-0e0ce4aaf6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29ac5e-adcf-49bd-ad25-0e0ce4aaf6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ef38a-f979-4dcc-84dd-1e9176e2c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Volume 9181ed76-6ae4-4b09-89ae-56a04c975156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9181ed76-6ae4-4b09-89ae-56a04c975156', 'volume_size': 1} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-262429310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9181ed76-6ae4-4b09-89ae-56a04c975156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6eed773857748a0854a77afb0f83323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:42:41Z,use_quota=True,user_id='84d53a9a71044156853639d222da3ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Creating volume 9181ed76-6ae4-4b09-89ae-56a04c975156 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:42:41 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:42:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2c21112a-3053-4777-9326-5cc27e64e72f tempest-ServerActionsTestOtherA-1281776106 None] Created volume successfully. Jul 08 18:42:41 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 1073741824 Jul 08 18:42:41 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:43 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 1073741824" returned: 0 in 1.399s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:43 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 Jul 08 18:42:43 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:44 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156" returned: 0 in 1.066s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118ef38a-f979-4dcc-84dd-1e9176e2c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9181ed76-6ae4-4b09-89ae-56a04c975156', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad226db-f178-4bdd-9ffe-58e2b84e5c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:42:44 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Volume volume-9181ed76-6ae4-4b09-89ae-56a04c975156 (9181ed76-6ae4-4b09-89ae-56a04c975156): created successfully Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad226db-f178-4bdd-9ffe-58e2b84e5c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:42:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Flow 'volume_create_manager' (7e634a3e-fa87-48ec-8937-18d609c583ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:42:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dfabfdc3-3911-4d7e-bcd6-12bc1b48da79 tempest-TaggedAttachmentsTest-379090930 None] Created volume successfully. Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Acquiring lock "cinder-caa3bb6e-fedb-4f61-98d2-535d408a2dab-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "cinder-caa3bb6e-fedb-4f61-98d2-535d408a2dab-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Acquiring lock "cinder-quobyte-caa3bb6e-fedb-4f61-98d2-535d408a2dab" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "cinder-quobyte-caa3bb6e-fedb-4f61-98d2-535d408a2dab" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dffe3d-108e-4377-9528-69837571d7e6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:42:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:48 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab Jul 08 18:42:48 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:49 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab" returned: 0 in 1.275s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:49 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab Jul 08 18:42:49 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:51 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-caa3bb6e-fedb-4f61-98d2-535d408a2dab" returned: 0 in 1.097s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "cinder-quobyte-caa3bb6e-fedb-4f61-98d2-535d408a2dab" released by "delete_volume" :: held 2.450s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Created reservations ['a724f59c-2862-43ca-9b9e-28c5b3f253d0', '882a6eac-cb3e-4e7a-b37e-a70dcbfd2094', 'a775b00c-1d76-4114-8c41-fe91ca587eb1', '29e2d2b3-d9eb-4d07-be48-260ab105e500'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:42:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:42:51 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:42:51 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:42:52 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Jul 08 18:42:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.343s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:42:52 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:42:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Deleted volume successfully. Jul 08 18:42:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-38b199b6-cc0b-4f55-af2a-cdac93c62c8a tempest-ServerRescueNegativeTestJSON-1641759664 None] Lock "cinder-caa3bb6e-fedb-4f61-98d2-535d408a2dab-delete_volume" released by "delete_volume" :: held 4.319s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:01 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:43:02 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=17,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:18 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:43:18 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:19 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.310s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:43:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 8 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:43:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Flow 'volume_create_manager' (628ce861-c7b8-4c74-b0dd-d961ec1ea247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1367d9bb-d9d0-41d9-b42a-51ff59661f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1367d9bb-d9d0-41d9-b42a-51ff59661f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-941938808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9381719b-4cc7-4b30-9f39-229517a1f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf44f60cf7d145d1afe55546e2146bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:28Z,use_quota=True,user_id='a6ab815cd27248be9b5aa15e05413f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a83d0a-28ba-4ce4-8140-e07830e0d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a83d0a-28ba-4ce4-8140-e07830e0d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1ad9e5-5477-4e6c-94ae-6049278601c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1ad9e5-5477-4e6c-94ae-6049278601c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9381719b-4cc7-4b30-9f39-229517a1f4bc', 'volume_name': 'volume-9381719b-4cc7-4b30-9f39-229517a1f4bc', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882ce40-7ca8-47eb-981b-00a7c61b2b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882ce40-7ca8-47eb-981b-00a7c61b2b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf477-3490-4405-b589-b46aefd70625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:28 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Volume 9381719b-4cc7-4b30-9f39-229517a1f4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9381719b-4cc7-4b30-9f39-229517a1f4bc', 'volume_size': 1} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-941938808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9381719b-4cc7-4b30-9f39-229517a1f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf44f60cf7d145d1afe55546e2146bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:28Z,use_quota=True,user_id='a6ab815cd27248be9b5aa15e05413f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Creating volume 9381719b-4cc7-4b30-9f39-229517a1f4bc {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:28 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:28 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc 1073741824 Jul 08 18:43:28 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-35176be5-f5a3-4179-887f-043efba9c679 tempest-BackendsCapabilitiesAdminTestsJSON-1045463751 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7276611328125, 'free_capacity_gb': 1775.7276611328125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87229) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:43:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-addd2be0-d138-4413-84da-e0df4818b7f0 tempest-BackendsCapabilitiesAdminTestsJSON-1045463751 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7276611328125, 'free_capacity_gb': 1775.7276611328125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87229) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:43:29 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc 1073741824" returned: 0 in 0.923s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:29 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc Jul 08 18:43:29 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:30 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf477-3490-4405-b589-b46aefd70625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9381719b-4cc7-4b30-9f39-229517a1f4bc', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8c8365-2a31-4f84-8632-552a95886cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:30 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Volume volume-9381719b-4cc7-4b30-9f39-229517a1f4bc (9381719b-4cc7-4b30-9f39-229517a1f4bc): created successfully Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8c8365-2a31-4f84-8632-552a95886cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Flow 'volume_create_manager' (628ce861-c7b8-4c74-b0dd-d961ec1ea247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:30 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6522219c-e284-49ed-937f-bc412b29728d tempest-DeleteServersTestJSON-1041234687 None] Created volume successfully. Jul 08 18:43:35 devstack cinder-volume[87229]: WARNING py.warnings [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 18:43:35 devstack cinder-volume[87229]: .first() Jul 08 18:43:35 devstack cinder-volume[87229]: Jul 08 18:43:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01887a6c-641c-4aba-a5b0-a085e9c5496f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:35 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa Jul 08 18:43:35 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:36 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa" returned: 0 in 1.240s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.281s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.060s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8391ffc1-390c-4488-8103-9b64581ff1e7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90cb2980-f3a7-42d3-a9bc-7f0d611d2f0b', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:36 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc Jul 08 18:43:36 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-d16da986-0b3d-48f6-9d0d-78494f485475 req-8d4f8292-6024-400c-80cd-52acb2580faf tempest-ServerActionsTestOtherA-1281776106 None] attachment_update completed successfully. Jul 08 18:43:37 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc" returned: 0 in 1.462s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.507s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-9381719b-4cc7-4b30-9f39-229517a1f4bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be5dbbd0-edd2-4145-9874-410d059edfdb', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-38f57f42-b8be-4a3d-8506-6e47fb9ff057 req-f56ede32-65c9-4183-8444-a3c76aacc546 tempest-DeleteServersTestJSON-1041234687 None] attachment_update completed successfully. Jul 08 18:43:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-799df75a-8871-4834-8826-8a42ef947640 req-5fbe2f0f-a260-4e93-81f6-51cc257e73e8 tempest-ServerActionsTestOtherA-1281776106 None] Terminate volume connection completed successfully. Jul 08 18:43:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-799df75a-8871-4834-8826-8a42ef947640 req-5fbe2f0f-a260-4e93-81f6-51cc257e73e8 tempest-ServerActionsTestOtherA-1281776106 None] Deleting attachment 90cb2980-f3a7-42d3-a9bc-7f0d611d2f0b. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:43:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-7b09952d-5ad7-44b4-be3a-7385b0db23f9 req-522fb184-c798-4779-b99e-607d02534612 tempest-DeleteServersTestJSON-1041234687 None] Terminate volume connection completed successfully. Jul 08 18:43:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-7b09952d-5ad7-44b4-be3a-7385b0db23f9 req-522fb184-c798-4779-b99e-607d02534612 tempest-DeleteServersTestJSON-1041234687 None] Deleting attachment be5dbbd0-edd2-4145-9874-410d059edfdb. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60686ce3-8dd8-45ce-a453-5725ea8e208f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:48 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa Jul 08 18:43:48 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:48 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa" returned: 0 in 0.917s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caeefcae-45a6-4043-9325-e76eebc9f4b0', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-799df75a-8871-4834-8826-8a42ef947640 req-13c7164b-3ba7-4e72-9647-c912cce4136a tempest-ServerActionsTestOtherA-1281776106 None] attachment_update completed successfully. Jul 08 18:43:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:50 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00be22-d40d-4f75-a669-25d11531e3f7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:50 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 Jul 08 18:43:50 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:51 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156" returned: 0 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-9181ed76-6ae4-4b09-89ae-56a04c975156', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb08274a-3348-47cc-9d8f-7c035191a374', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:43:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-1845e527-a97c-471b-8e0b-beda27496d83 req-18a93213-0859-4f8e-92ad-c1cf6ec9aa8e tempest-TaggedAttachmentsTest-379090930 None] attachment_update completed successfully. Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Flow 'volume_create_manager' (3e51b897-59be-4be6-849f-1b0885fd2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e444a52-3ede-48bc-a095-1464533fd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "cinder-9381719b-4cc7-4b30-9f39-229517a1f4bc-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e444a52-3ede-48bc-a095-1464533fd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-301585885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bbd2bb-636f-4322-8d20-3b468ae14b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56bf25747124441ae8510e54be88510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:52Z,use_quota=True,user_id='9368f63d195a468b83fdd7791d6eb07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d27a3-5477-4c2b-8d1a-94b13e1484c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d27a3-5477-4c2b-8d1a-94b13e1484c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec5560-0f14-46f0-b604-dfefe1eca8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec5560-0f14-46f0-b604-dfefe1eca8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bbd2bb-636f-4322-8d20-3b468ae14b4b', 'volume_name': 'volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbfe615-c74a-40e1-828b-b062c46952b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbfe615-c74a-40e1-828b-b062c46952b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c355492f-1728-4a05-90bf-d0f57b0ea5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Volume 93bbd2bb-636f-4322-8d20-3b468ae14b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b', 'volume_size': 1} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-301585885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bbd2bb-636f-4322-8d20-3b468ae14b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56bf25747124441ae8510e54be88510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:43:52Z,use_quota=True,user_id='9368f63d195a468b83fdd7791d6eb07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Creating volume 93bbd2bb-636f-4322-8d20-3b468ae14b4b {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:43:52 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "cinder-9381719b-4cc7-4b30-9f39-229517a1f4bc-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:52 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b 1073741824 Jul 08 18:43:52 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "cinder-quobyte-9381719b-4cc7-4b30-9f39-229517a1f4bc" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "cinder-quobyte-9381719b-4cc7-4b30-9f39-229517a1f4bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7b45d-7197-4146-bd1e-36d0813fc2be]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:52 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc Jul 08 18:43:52 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:53 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b 1073741824" returned: 0 in 1.111s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:53 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc" returned: 0 in 1.023s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:53 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc Jul 08 18:43:53 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:53 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b Jul 08 18:43:53 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:54 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9381719b-4cc7-4b30-9f39-229517a1f4bc" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:54 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "cinder-quobyte-9381719b-4cc7-4b30-9f39-229517a1f4bc" released by "delete_volume" :: held 1.842s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c355492f-1728-4a05-90bf-d0f57b0ea5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cc32f4-8d5f-4ee8-a71b-c339f1154e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:43:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Volume volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b (93bbd2bb-636f-4322-8d20-3b468ae14b4b): created successfully Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cc32f4-8d5f-4ee8-a71b-c339f1154e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Flow 'volume_create_manager' (3e51b897-59be-4be6-849f-1b0885fd2525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:43:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-65d866d6-fec0-4d4e-a582-aa7d516ebbae tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Created volume successfully. Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Created reservations ['e233e243-80e3-45d2-bc30-3cae3c4a4157', '4f43a1c6-0694-4ab9-beb5-608aa48d15a9', '0d9bcd98-fad0-4352-887f-598e1c2df9b1', '2431fd5d-1419-4bbc-b86b-16713ae36b74'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:54 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:43:54 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:54 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.672s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:43:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Deleted volume successfully. Jul 08 18:43:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f2b62e1b-0dc0-4a43-968f-438c361902ea tempest-DeleteServersTestJSON-1041234687 None] Lock "cinder-9381719b-4cc7-4b30-9f39-229517a1f4bc-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Acquiring lock "cinder-93bbd2bb-636f-4322-8d20-3b468ae14b4b-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "cinder-93bbd2bb-636f-4322-8d20-3b468ae14b4b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Acquiring lock "cinder-quobyte-93bbd2bb-636f-4322-8d20-3b468ae14b4b" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "cinder-quobyte-93bbd2bb-636f-4322-8d20-3b468ae14b4b" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e38d21f-96e0-4c78-a925-6a55a8ae9be0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:43:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:56 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b Jul 08 18:43:56 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:58 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b" returned: 0 in 1.375s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:58 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b Jul 08 18:43:58 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:43:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-76b6b907-41ff-4059-92ac-741acb421b2f req-84757680-8a81-46dc-afae-199e2f026dd7 tempest-TaggedAttachmentsTest-379090930 None] Terminate volume connection completed successfully. Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-76b6b907-41ff-4059-92ac-741acb421b2f req-84757680-8a81-46dc-afae-199e2f026dd7 tempest-TaggedAttachmentsTest-379090930 None] Deleting attachment fb08274a-3348-47cc-9d8f-7c035191a374. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:43:59 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-93bbd2bb-636f-4322-8d20-3b468ae14b4b" returned: 0 in 1.049s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "cinder-quobyte-93bbd2bb-636f-4322-8d20-3b468ae14b4b" released by "delete_volume" :: held 2.488s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Created reservations ['61da1b91-19d7-45e6-a8f4-772cd6c7e54a', 'cdb58b16-edb9-4d9f-935f-e0d076fd4046', '0783c747-181c-4400-b909-d47f1c33f1f2', '11829b3a-799e-4201-95c9-e97ac1d21f7b'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:43:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:43:59 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:43:59 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:00 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.807s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:00 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:00 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Deleted volume successfully. Jul 08 18:44:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e965c22e-8485-4027-8a2f-aa5e90316eed tempest-VolumeQuotasNegativeTestJSON-1074969595 None] Lock "cinder-93bbd2bb-636f-4322-8d20-3b468ae14b4b-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Flow 'volume_create_manager' (83e4ff30-8895-4ae9-9aac-db8f591b027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb6e5c0-b3c9-4822-b303-c7cd0ae7e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb6e5c0-b3c9-4822-b303-c7cd0ae7e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-488138946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335216ca-ff42-44b7-b2e2-295011de0133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3578d89f5bde472ea624dbcf6486d155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:08Z,use_quota=True,user_id='d924c47f5a4a47d69f4e14d7e0591b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61f7d43-50d3-40fd-92e2-9437564560dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61f7d43-50d3-40fd-92e2-9437564560dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c53549-d01b-4f8e-b3c2-62741cc56d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c53549-d01b-4f8e-b3c2-62741cc56d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335216ca-ff42-44b7-b2e2-295011de0133', 'volume_name': 'volume-335216ca-ff42-44b7-b2e2-295011de0133', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23efcbd0-996c-4c68-989a-6cd92065270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23efcbd0-996c-4c68-989a-6cd92065270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88130669-e022-46e2-9a44-bcf7a705d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Volume 335216ca-ff42-44b7-b2e2-295011de0133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335216ca-ff42-44b7-b2e2-295011de0133', 'volume_size': 1} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-488138946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335216ca-ff42-44b7-b2e2-295011de0133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3578d89f5bde472ea624dbcf6486d155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:08Z,use_quota=True,user_id='d924c47f5a4a47d69f4e14d7e0591b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Creating volume 335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:44:08 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:44:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:08 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 1073741824 Jul 08 18:44:08 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:09 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 1073741824" returned: 0 in 1.317s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:09 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 Jul 08 18:44:09 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:10 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133" returned: 0 in 0.767s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88130669-e022-46e2-9a44-bcf7a705d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335216ca-ff42-44b7-b2e2-295011de0133', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c3ef4e-8c49-4d84-919a-af235fc1c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Volume volume-335216ca-ff42-44b7-b2e2-295011de0133 (335216ca-ff42-44b7-b2e2-295011de0133): created successfully Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c3ef4e-8c49-4d84-919a-af235fc1c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Flow 'volume_create_manager' (83e4ff30-8895-4ae9-9aac-db8f591b027d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6e8169b3-5adc-46a7-80f6-df6237a416ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Created volume successfully. Jul 08 18:44:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Creating offline snapshot f78bf283-ed89-4a04-abbc-cd818b1eff5b of volume 335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:44:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd90ca-8972-4a2f-8f7e-cffcdcad7249]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:12 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 Jul 08 18:44:12 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:13 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133" returned: 0 in 1.043s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:13 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b 1G Jul 08 18:44:13 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:13 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b 1G" returned: 0 in 0.874s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335216ca-ff42-44b7-b2e2-295011de0133 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:13 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335216ca-ff42-44b7-b2e2-295011de0133 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b Jul 08 18:44:13 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:14 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335216ca-ff42-44b7-b2e2-295011de0133 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b" returned: 0 in 0.879s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:14 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b is being set with open permissions: ugo+rw Jul 08 18:44:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:14 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b Jul 08 18:44:14 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:15 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b" returned: 0 in 0.710s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:15 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info Jul 08 18:44:15 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:16 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:16 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info is being set with open permissions: ugo+rw Jul 08 18:44:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:16 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info Jul 08 18:44:16 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:17 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.info" returned: 0 in 0.767s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.170s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-69ef4ccc-441d-4747-85db-507e09d80ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Create snapshot completed successfully Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "cinder-f78bf283-ed89-4a04-abbc-cd818b1eff5b-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-f78bf283-ed89-4a04-abbc-cd818b1eff5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "cinder-quobyte-f78bf283-ed89-4a04-abbc-cd818b1eff5b" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-f78bf283-ed89-4a04-abbc-cd818b1eff5b" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Deleting offline snapshot f78bf283-ed89-4a04-abbc-cd818b1eff5b of volume 335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:44:18 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:44:18 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] snapshot_file for this snap is: volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f90649-e1fe-439b-9abf-09764db2537b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:18 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b Jul 08 18:44:18 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:18 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.793s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:19 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b" returned: 0 in 1.158s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335216ca-ff42-44b7-b2e2-295011de0133(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a71a4d-c131-4abe-9e6e-e53741d3fed8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "cinder-9181ed76-6ae4-4b09-89ae-56a04c975156-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "cinder-9181ed76-6ae4-4b09-89ae-56a04c975156-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:19 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 Jul 08 18:44:19 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "cinder-quobyte-9181ed76-6ae4-4b09-89ae-56a04c975156" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "cinder-quobyte-9181ed76-6ae4-4b09-89ae-56a04c975156" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe715a8b-a513-426b-bdd1-a5efee8ef6c8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:19 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 Jul 08 18:44:19 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:20 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133" returned: 0 in 0.867s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:20 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b Jul 08 18:44:20 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-9634edc9-e05d-4c95-8bd8-cbd3cfb5cd32 req-44def20e-ba5b-47ca-ac4c-f564213de0ce tempest-ServerActionsTestOtherA-1281776106 None] Terminate volume connection completed successfully. Jul 08 18:44:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-9634edc9-e05d-4c95-8bd8-cbd3cfb5cd32 req-44def20e-ba5b-47ca-ac4c-f564213de0ce tempest-ServerActionsTestOtherA-1281776106 None] Deleting attachment caeefcae-45a6-4043-9325-e76eebc9f4b0. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:44:20 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:20 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156 Jul 08 18:44:20 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:21 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b" returned: 0 in 0.875s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:21 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b Jul 08 18:44:21 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:21 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9181ed76-6ae4-4b09-89ae-56a04c975156" returned: 0 in 0.775s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "cinder-quobyte-9181ed76-6ae4-4b09-89ae-56a04c975156" released by "delete_volume" :: held 1.671s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Created reservations ['c63c56e1-e466-4afc-8a3e-36e3599e5284', '2e212917-f923-422b-ada1-c00db9f60680', '25eafe1b-38be-42fd-9931-da50ab51d6fe', '8b96c334-2e61-4ec9-824a-df7c8e1de0a0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:21 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:44:21 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:21 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133.f78bf283-ed89-4a04-abbc-cd818b1eff5b" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:21 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=50,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-f78bf283-ed89-4a04-abbc-cd818b1eff5b" released by "_delete_snapshot" :: held 3.830s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" released by "delete_snapshot" :: held 3.900s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:22 devstack cinder-volume[87229]: WARNING cinder.quota [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Created reservations ['41c7c9d2-504c-41bb-8b6d-5381686a3bda', '0d100075-bf0f-4242-ae45-ed6aa289f5cd', '1927939f-938e-4453-a489-59f08db82949', '0126e7bd-6604-4124-94dd-2bb1acb70055'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:22 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.719s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Deleted volume successfully. Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-31bbbcad-5780-4673-bd16-5187fadf7d59 tempest-TaggedAttachmentsTest-379090930 None] Lock "cinder-9181ed76-6ae4-4b09-89ae-56a04c975156-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Delete snapshot completed successfully. Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-85179d22-9d44-4b17-9a49-92f21fe9eecc tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-f78bf283-ed89-4a04-abbc-cd818b1eff5b-delete_snapshot" released by "delete_snapshot" :: held 4.095s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "cinder-335216ca-ff42-44b7-b2e2-295011de0133-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-335216ca-ff42-44b7-b2e2-295011de0133-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f191ec3b-1744-48f4-8a71-26573f0c9eb1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:22 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 Jul 08 18:44:22 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:23 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133" returned: 0 in 0.975s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:23 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133 Jul 08 18:44:23 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:24 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-335216ca-ff42-44b7-b2e2-295011de0133" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-quobyte-335216ca-ff42-44b7-b2e2-295011de0133" released by "delete_volume" :: held 2.012s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=49,cinder:SELECT=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Created reservations ['a8349e4e-26b4-44b2-b0b4-8de78d59e19c', 'f06c5130-be1f-455c-b38e-187d2c03c5e8', 'f1c499f9-2196-4fbd-bb5c-6765364ad46c', '4bc3a9e0-3dd5-4aec-b82f-6b1288e65e84'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:24 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:44:24 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:25 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.971s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:25 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Deleted volume successfully. Jul 08 18:44:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0a601e45-5eac-4638-a1d3-2aaed2a8f7a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119417937 None] Lock "cinder-335216ca-ff42-44b7-b2e2-295011de0133-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "cinder-845d444e-c5da-42d0-91ec-9cc3b011f5aa-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "cinder-845d444e-c5da-42d0-91ec-9cc3b011f5aa-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "cinder-quobyte-845d444e-c5da-42d0-91ec-9cc3b011f5aa" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:44:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "cinder-quobyte-845d444e-c5da-42d0-91ec-9cc3b011f5aa" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:44:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de231f4f-794d-49c6-98a6-06da3450667c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:44:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:35 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa Jul 08 18:44:35 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:36 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa" returned: 0 in 1.123s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:36 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa Jul 08 18:44:36 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:37 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-845d444e-c5da-42d0-91ec-9cc3b011f5aa" returned: 0 in 0.977s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "cinder-quobyte-845d444e-c5da-42d0-91ec-9cc3b011f5aa" released by "delete_volume" :: held 2.168s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Created reservations ['77632ed7-43c5-4ff5-bef5-2ebe1f3e91b6', '0c958f5d-5415-4f42-8224-41bffbbe306b', 'bebb5736-965d-490c-a6f7-fe3f93ad0022', '2135c49c-93ce-4737-9402-fd266b001a56'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:37 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:44:37 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:38 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.886s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:44:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Deleted volume successfully. Jul 08 18:44:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21cf6f4e-696d-4c89-b5a1-d3b322fc7edd tempest-ServerActionsTestOtherA-1281776106 None] Lock "cinder-845d444e-c5da-42d0-91ec-9cc3b011f5aa-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:44:47 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:INSERT=4,cinder:UPDATE=13,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:48 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (7f90f13a-2a7a-49a6-9a0e-3fb26cb4f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ba88ec-165d-41b8-a7a5-02c420fe4b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ba88ec-165d-41b8-a7a5-02c420fe4b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2065732737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:58Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483e5d5d-6997-4945-bd0a-19bd5165a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483e5d5d-6997-4945-bd0a-19bd5165a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbe837c-261c-4854-83f5-f7f29fd1d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbe837c-261c-4854-83f5-f7f29fd1d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76', 'volume_name': 'volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e723a05-15c2-4940-b9b7-1ec6fc023139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e723a05-15c2-4940-b9b7-1ec6fc023139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc1f77-971e-423e-9643-814f4f016fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:44:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Volume 59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76', 'volume_size': 1} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2065732737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:44:58Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Creating volume 59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:44:58 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:44:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:58 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 1073741824 Jul 08 18:44:58 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:44:59 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Jul 08 18:44:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 1073741824" returned: 0 in 1.045s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:44:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:44:59 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 Jul 08 18:44:59 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:00 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc1f77-971e-423e-9643-814f4f016fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d9465b-dc55-49f1-b7f7-cc7231fe2582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:00 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Volume volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 (59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76): created successfully Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d9465b-dc55-49f1-b7f7-cc7231fe2582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (7f90f13a-2a7a-49a6-9a0e-3fb26cb4f755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:00 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4f51c757-6869-4a4e-9d25-848604a0dbc4 tempest-AttachVolumeNegativeTest-901206521 None] Created volume successfully. Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Flow 'volume_create_manager' (fe053fe9-7d6a-4a23-a696-5d3cf7c22249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6321977-bc8d-4c9d-84a7-4ad59ccd641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6321977-bc8d-4c9d-84a7-4ad59ccd641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1397170102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d1b84-c43e-435a-b0d0-923f48ee5783,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03b7ada67f96419ba6cc360e1a610b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:02Z,use_quota=True,user_id='3e1ab3107e584fc0b654089817d54d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d67963-b2e0-4e85-bc95-4b4afa240a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d67963-b2e0-4e85-bc95-4b4afa240a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a7d28-9a66-4237-931d-642a32bd28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a7d28-9a66-4237-931d-642a32bd28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429d1b84-c43e-435a-b0d0-923f48ee5783', 'volume_name': 'volume-429d1b84-c43e-435a-b0d0-923f48ee5783', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8322dae0-47ca-44ab-b98d-42b2d75a0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8322dae0-47ca-44ab-b98d-42b2d75a0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b6a351-0e59-4395-8758-b52f677da83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Volume 429d1b84-c43e-435a-b0d0-923f48ee5783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429d1b84-c43e-435a-b0d0-923f48ee5783', 'volume_size': 1} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1397170102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d1b84-c43e-435a-b0d0-923f48ee5783,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03b7ada67f96419ba6cc360e1a610b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:02Z,use_quota=True,user_id='3e1ab3107e584fc0b654089817d54d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Creating volume 429d1b84-c43e-435a-b0d0-923f48ee5783 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:01 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:45:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:01 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 1073741824 Jul 08 18:45:01 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:02 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 1073741824" returned: 0 in 1.018s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:03 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 Jul 08 18:45:03 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:03 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783" returned: 0 in 0.913s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b6a351-0e59-4395-8758-b52f677da83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429d1b84-c43e-435a-b0d0-923f48ee5783', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9b514a-6561-47c6-9caa-6ecaa5bfaf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Volume volume-429d1b84-c43e-435a-b0d0-923f48ee5783 (429d1b84-c43e-435a-b0d0-923f48ee5783): created successfully Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9b514a-6561-47c6-9caa-6ecaa5bfaf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Flow 'volume_create_manager' (fe053fe9-7d6a-4a23-a696-5d3cf7c22249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-a51f1c5e-ef55-44db-9144-bfa684014ee6 req-8a77e67b-543b-488f-9324-eb75fd0f8d76 tempest-VolumesGetTestJSON-820625576 None] Created volume successfully. Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd69d324-7f7d-4518-9d0a-261b34855553]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:05 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 Jul 08 18:45:05 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Acquiring lock "cinder-429d1b84-c43e-435a-b0d0-923f48ee5783-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "cinder-429d1b84-c43e-435a-b0d0-923f48ee5783-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Acquiring lock "cinder-quobyte-429d1b84-c43e-435a-b0d0-923f48ee5783" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "cinder-quobyte-429d1b84-c43e-435a-b0d0-923f48ee5783" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b1f73-ac19-4fff-962f-69b09a3016fa]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:05 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 Jul 08 18:45:05 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:05 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" returned: 0 in 0.928s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.953s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d0ba623-ae17-423f-9270-71620c9b4828', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:45:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-542d0528-5e98-48b7-a034-82ac185cc506 req-15afdd54-ee9c-4f01-b661-43fde675d972 tempest-AttachVolumeNegativeTest-901206521 None] attachment_update completed successfully. Jul 08 18:45:06 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783" returned: 0 in 0.901s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:06 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783 Jul 08 18:45:06 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:07 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-429d1b84-c43e-435a-b0d0-923f48ee5783" returned: 0 in 0.839s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "cinder-quobyte-429d1b84-c43e-435a-b0d0-923f48ee5783" released by "delete_volume" :: held 1.799s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG cinder.quota [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Created reservations ['13428dfc-5484-4a84-9837-345bb064a5f1', '6ff952f8-cbfb-4c28-98c1-df8d35f23f7b', '5a7821aa-2e40-43bd-b4a9-cb684eec0c12', '7f189b6e-df09-41ee-8570-db1af446afb5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:07 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:07 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:08 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.836s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:08 devstack cinder-volume[87229]: DEBUG cinder.manager [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Deleted volume successfully. Jul 08 18:45:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-2798528f-8a45-46e0-bb88-1fe7225f7545 req-2a90f38e-f30b-4472-975f-5334227a7753 tempest-VolumesGetTestJSON-820625576 None] Lock "cinder-429d1b84-c43e-435a-b0d0-923f48ee5783-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2bbf338e-0821-49db-a644-b0d811f4a13c tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-387769005: creating Jul 08 18:45:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2bbf338e-0821-49db-a644-b0d811f4a13c tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-387769005: created successfully Jul 08 18:45:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2bbf338e-0821-49db-a644-b0d811f4a13c tempest-GroupSnapshotsTest-403874491 None] Create group completed successfully. Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (624b91f0-9eb7-43c5-9c53-edd1fc9bda0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822885db-97c6-44b8-9fd7-09816fb12fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822885db-97c6-44b8-9fd7-09816fb12fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182878689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5bcf6a6-fa07-4913-9eb3-6019206990ef,host='devstack@QuobyteHD#QuobyteHD',id=cd2dddc7-b51a-48f1-b690-666e74127fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:16Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20986208-bab5-4cab-a068-3ca18b48c4c1),volume_type_id=20986208-bab5-4cab-a068-3ca18b48c4c1)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc02aa72-6809-440a-a08a-970fbe976c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc02aa72-6809-440a-a08a-970fbe976c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c446b5c0-6401-41fb-bb7f-bccc15b97405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c446b5c0-6401-41fb-bb7f-bccc15b97405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2dddc7-b51a-48f1-b690-666e74127fe8', 'volume_name': 'volume-cd2dddc7-b51a-48f1-b690-666e74127fe8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef26b4a-5fe3-4de3-b8bc-56373a5c4ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef26b4a-5fe3-4de3-b8bc-56373a5c4ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f16c16-f586-4d72-bacc-dba320bccba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:16 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Volume cd2dddc7-b51a-48f1-b690-666e74127fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2dddc7-b51a-48f1-b690-666e74127fe8', 'volume_size': 1} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5bcf6a6-fa07-4913-9eb3-6019206990ef,created_at=2026-07-08T16:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182878689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5bcf6a6-fa07-4913-9eb3-6019206990ef,host='devstack@QuobyteHD#QuobyteHD',id=cd2dddc7-b51a-48f1-b690-666e74127fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:16Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20986208-bab5-4cab-a068-3ca18b48c4c1),volume_type_id=20986208-bab5-4cab-a068-3ca18b48c4c1)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Creating volume cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:16 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:45:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:16 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 1073741824 Jul 08 18:45:16 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 1073741824" returned: 0 in 1.441s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:18 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:18 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:18 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:18 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:19 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 0.932s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] <== create_volume: return (2487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f16c16-f586-4d72-bacc-dba320bccba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2dddc7-b51a-48f1-b690-666e74127fe8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74bed2f-d97b-453a-bea5-56c770daa7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:19 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Volume volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 (cd2dddc7-b51a-48f1-b690-666e74127fe8): created successfully Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74bed2f-d97b-453a-bea5-56c770daa7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (624b91f0-9eb7-43c5-9c53-edd1fc9bda0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4c6f7ff3-0996-45c7-9534-50e9ca98844e tempest-GroupSnapshotsTest-403874491 None] Created volume successfully. Jul 08 18:45:19 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.369s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 8 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:45:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:45:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] GroupSnapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: creating. Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Group snapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: creating. {{(pid=87229) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Creating offline snapshot 5238f560-6196-4f37-8021-9c08e00ada2e of volume cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e17867-c8f7-4778-a0c6-8d52d98555d5]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:21 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:21 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:22 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 1.161s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:22 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e 1G Jul 08 18:45:22 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:23 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e 1G" returned: 0 in 1.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:23 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:23 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:25 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 1.190s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:25 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:25 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:25 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:26 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 1.011s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:26 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info Jul 08 18:45:26 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:27 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info" returned: 0 in 0.959s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:27 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:27 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info Jul 08 18:45:27 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:27 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.info" returned: 0 in 0.724s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.847s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5f29a289-f60a-47c1-b7e0-a1642141bdd7 tempest-GroupSnapshotsTest-403874491 None] group_snapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: created successfully Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e-1a5c9718-17f1-4f0f-8224-2ed283bd177f" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e-1a5c9718-17f1-4f0f-8224-2ed283bd177f" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Creating volume 1a5c9718-17f1-4f0f-8224-2ed283bd177f from snapshot 5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] snapshot: 5238f560-6196-4f37-8021-9c08e00ada2e, volume: 1a5c9718-17f1-4f0f-8224-2ed283bd177f, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0cd90-644f-4ad1-bea4-4b0dd10c88a2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:30 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:30 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:31 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (61d36c35-f634-4d6c-a17f-11572fcc433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2573437e-24ad-48f3-b8e8-4a7299dd3dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2573437e-24ad-48f3-b8e8-4a7299dd3dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-924024654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed60107b-86a3-405f-9821-56bf9b4b9a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:32Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d561f9f4-83f0-4c65-be5f-fc42f5baaeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d561f9f4-83f0-4c65-be5f-fc42f5baaeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0455908-c2a2-4ae1-a2cf-a01edb10aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0455908-c2a2-4ae1-a2cf-a01edb10aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed60107b-86a3-405f-9821-56bf9b4b9a26', 'volume_name': 'volume-ed60107b-86a3-405f-9821-56bf9b4b9a26', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce34f7a2-235b-4b7b-8ef8-74dceae6e87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce34f7a2-235b-4b7b-8ef8-74dceae6e87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b091c2-6a8d-4570-a5e9-6dc1bdeb4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:32 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Volume ed60107b-86a3-405f-9821-56bf9b4b9a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed60107b-86a3-405f-9821-56bf9b4b9a26', 'volume_size': 1} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:32 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 1.951s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd2dddc7-b51a-48f1-b690-666e74127fe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71bab9-9976-4c09-9ed3-66b1ac1dd3cb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:32 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:32 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:34 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 2.135s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:34 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:45:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:34 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f Jul 08 18:45:34 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:40 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=23,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:45:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=32,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:45:45 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f" returned: 0 in 11.190s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a575234-9fe9-4215-ae46-25ce6de2213f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:45 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:45 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:46 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 0.991s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:46 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8, size 1024.00 MB, duration 11.20 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:45:46 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Converted 1024.00 MB image at 91.45 MB/s Jul 08 18:45:46 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:45:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:46 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f Jul 08 18:45:46 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:47 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f" returned: 0 in 0.645s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" released by "_copy_volume_from_snapshot" :: held 17.111s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e-1a5c9718-17f1-4f0f-8224-2ed283bd177f" released by "_create_volume_from_snapshot" :: held 17.182s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.237s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.289s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-924024654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed60107b-86a3-405f-9821-56bf9b4b9a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:32Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Creating volume ed60107b-86a3-405f-9821-56bf9b4b9a26 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:47 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:45:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:47 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 1073741824 Jul 08 18:45:47 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7ac1831b-3b5b-496b-b066-0865b225eddb tempest-GroupSnapshotsTest-403874491 None] Create group from source-snapshot-8e109d2d-cb65-404a-9a46-2b1d48d208b3 completed successfully. Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" acquired by "delete_volume" :: waited 0.053s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:48 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 1073741824" returned: 0 in 1.239s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3448f525-aea5-4430-be60-7b3e81dfe87f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Flow 'volume_create_manager' (c0f886c8-c158-4593-9a1c-00b46703d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f30db43-e73b-45ac-9e0d-9fa393396776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f30db43-e73b-45ac-9e0d-9fa393396776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2009876109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb08ffe-6c84-4f8f-8b8a-143ed70da48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14cbb05cd1743b7badcb1c56364d05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:49Z,use_quota=True,user_id='a208dd1a6f9842339f31b618c46ec345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:48 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 Jul 08 18:45:48 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1f2995-37ec-45ef-a346-d6006a99a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:48 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f Jul 08 18:45:48 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1f2995-37ec-45ef-a346-d6006a99a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5048eb-5cb6-4a4c-82df-317ad8aca94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5048eb-5cb6-4a4c-82df-317ad8aca94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb08ffe-6c84-4f8f-8b8a-143ed70da48d', 'volume_name': 'volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6af3fa-64a1-440c-8222-522e80d0dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6af3fa-64a1-440c-8222-522e80d0dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d9ae21-c608-42fb-96ea-e65b2f3970af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Volume aeb08ffe-6c84-4f8f-8b8a-143ed70da48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d', 'volume_size': 1} Jul 08 18:45:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:49 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:49 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f Jul 08 18:45:49 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:49 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26" returned: 0 in 0.746s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2009876109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb08ffe-6c84-4f8f-8b8a-143ed70da48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14cbb05cd1743b7badcb1c56364d05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:49Z,use_quota=True,user_id='a208dd1a6f9842339f31b618c46ec345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Creating volume aeb08ffe-6c84-4f8f-8b8a-143ed70da48d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:49 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:49 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d 1073741824 Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b091c2-6a8d-4570-a5e9-6dc1bdeb4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed60107b-86a3-405f-9821-56bf9b4b9a26', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:49 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fa3a23-3001-4b74-9bcb-744362acac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:49 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Volume volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 (ed60107b-86a3-405f-9821-56bf9b4b9a26): created successfully Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fa3a23-3001-4b74-9bcb-744362acac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (61d36c35-f634-4d6c-a17f-11572fcc433e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-cc8e80a3-c53a-490f-a8f5-48ed8fb009b0 tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-adde8174-4ad5-445b-9069-8412aabf5dac tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26" by "attach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-adde8174-4ad5-445b-9069-8412aabf5dac tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26" acquired by "attach_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-adde8174-4ad5-445b-9069-8412aabf5dac tempest-VolumesActionsTest-1710871339 None] Attaching volume ed60107b-86a3-405f-9821-56bf9b4b9a26 to instance 447297a2-b5ae-4b59-bce3-919a38c5ccb7 at mountpoint /dev/vdb on host None. Jul 08 18:45:50 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-adde8174-4ad5-445b-9069-8412aabf5dac tempest-VolumesActionsTest-1710871339 None] Attach volume completed successfully. Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-adde8174-4ad5-445b-9069-8412aabf5dac tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26" released by "attach_volume" :: held 0.156s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:50 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1a5c9718-17f1-4f0f-8224-2ed283bd177f" returned: 0 in 0.737s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-1a5c9718-17f1-4f0f-8224-2ed283bd177f" released by "delete_volume" :: held 1.614s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['7405a967-abb0-4492-b650-81760b8725f0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:50 devstack cinder-volume[87229]: WARNING cinder.quota [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1150057454 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1150057454, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:50 devstack cinder-volume[87229]: WARNING cinder.quota [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1150057454 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1150057454, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['23260116-1b58-4d2a-84e8-6db3ab2cbe00', 'aa098d36-e2da-40f3-99f0-bfe90fd08e2f', 'fee465e9-dfe0-40c2-b9c3-d265390ddae4', 'd89c6fd7-22f5-4307-8926-6c519cf594b2'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:50 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:50 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:50 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d 1073741824" returned: 0 in 1.298s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:50 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d Jul 08 18:45:50 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Terminate volume connection completed successfully. Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] group_snapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: deleting Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] group_snapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: deleting {{(pid=87229) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Deleting offline snapshot 5238f560-6196-4f37-8021-9c08e00ada2e of volume cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] snapshot_file for this snap is: volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e6d76-782b-4d78-9915-b7ff5f26bca9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:51 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:51 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:51 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.078s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-152cb37c-5608-4954-97a6-045569444886 tempest-GroupSnapshotsTest-403874491 None] Delete group completed successfully. Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" by "detach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Detaching volume ed60107b-86a3-405f-9821-56bf9b4b9a26 from instance 447297a2-b5ae-4b59-bce3-919a38c5ccb7. Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Detach volume completed successfully. Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19ea1f75-f6c0-432c-af73-f545bcc9133c tempest-VolumesActionsTest-2119170412 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:51 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d9ae21-c608-42fb-96ea-e65b2f3970af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38cb26-d603-4d18-a8c4-68d86e412777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Volume volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d (aeb08ffe-6c84-4f8f-8b8a-143ed70da48d): created successfully Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a38cb26-d603-4d18-a8c4-68d86e412777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Flow 'volume_create_manager' (c0f886c8-c158-4593-9a1c-00b46703d356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3c38b24b-e836-4b38-bb02-94f37ce068f6 tempest-ServersNegativeTestJSON-1556650175 None] Created volume successfully. Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5ccf83b-dbed-4455-8bbf-0685c786cc37 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" by "detach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5ccf83b-dbed-4455-8bbf-0685c786cc37 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f5ccf83b-dbed-4455-8bbf-0685c786cc37 tempest-VolumesActionsTest-1710871339 None] Volume detach called, but volume not attached. Jul 08 18:45:52 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5ccf83b-dbed-4455-8bbf-0685c786cc37 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 0.992s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd2dddc7-b51a-48f1-b690-666e74127fe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f64ffd-5be2-4b59-9680-332116ec3f5d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:52 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:52 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-quobyte-ed60107b-86a3-405f-9821-56bf9b4b9a26" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-quobyte-ed60107b-86a3-405f-9821-56bf9b4b9a26" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cdefa2-a053-4bec-8b30-15ee712112ad]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:53 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 0.878s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:53 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:53 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:53 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 Jul 08 18:45:53 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26" returned: 0 in 0.852s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26 Jul 08 18:45:54 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e Jul 08 18:45:54 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Flow 'volume_create_manager' (f7cdd55d-97c5-4de8-a8b6-916678c4650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e68fad5-af3a-493d-b03c-446f3dffe643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e68fad5-af3a-493d-b03c-446f3dffe643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-379853656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5f1ed7-d888-49c9-8291-68eb99fe2ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14cbb05cd1743b7badcb1c56364d05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:54Z,use_quota=True,user_id='a208dd1a6f9842339f31b618c46ec345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f0de28-22d8-4ae9-9cca-7b4f1fa7ce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f0de28-22d8-4ae9-9cca-7b4f1fa7ce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ea8160-8844-4f0e-a7a3-f0d363697ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ea8160-8844-4f0e-a7a3-f0d363697ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5f1ed7-d888-49c9-8291-68eb99fe2ce1', 'volume_name': 'volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da72b7e-3fab-4bc5-bc11-ccc59bf59dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da72b7e-3fab-4bc5-bc11-ccc59bf59dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c952ee-0ea8-44cd-8fd0-dbeb4c3549c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Volume 0d5f1ed7-d888-49c9-8291-68eb99fe2ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1', 'volume_size': 1} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-379853656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5f1ed7-d888-49c9-8291-68eb99fe2ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14cbb05cd1743b7badcb1c56364d05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:45:54Z,use_quota=True,user_id='a208dd1a6f9842339f31b618c46ec345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Creating volume 0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:45:54 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:54 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 1073741824 Jul 08 18:45:54 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:54 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed60107b-86a3-405f-9821-56bf9b4b9a26" returned: 0 in 0.688s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-quobyte-ed60107b-86a3-405f-9821-56bf9b4b9a26" released by "delete_volume" :: held 1.588s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:54 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8.5238f560-6196-4f37-8021-9c08e00ada2e" returned: 0 in 0.735s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-5238f560-6196-4f37-8021-9c08e00ada2e" released by "_delete_snapshot" :: held 3.513s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" released by "delete_snapshot" :: held 3.547s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:54 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Created reservations ['4c637802-2e2f-48c6-978a-0e02a74a8dcb', '22df6c34-0733-4319-91db-efd6b9459b23', '238c2c94-e2eb-4862-88e3-06174df270c1', '164f6ba6-49a9-4267-ae8b-e642b62fd39c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:55 devstack cinder-volume[87229]: WARNING cinder.quota [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1150057454 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1150057454, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:55 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:55 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] Created reservations ['adb5c347-284d-4397-86a6-def58fce90f4', '78638cae-c98b-44ec-b5d4-5d050c26e5b8', '33346cda-02d4-4f87-987a-efd457c2eb02', '5430c7a1-636a-428b-9992-4fdf6443d545'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0d823b99-94e4-47a9-9068-eb1e03ef950e tempest-GroupSnapshotsTest-403874491 None] group_snapshot 8e109d2d-cb65-404a-9a46-2b1d48d208b3: deleted successfully Jul 08 18:45:55 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 1073741824" returned: 0 in 0.876s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:55 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 Jul 08 18:45:55 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:55 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Deleted volume successfully. Jul 08 18:45:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-36684a7a-4ac1-4c79-a613-e0324b756403 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-ed60107b-86a3-405f-9821-56bf9b4b9a26-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:56 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" returned: 0 in 0.705s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c952ee-0ea8-44cd-8fd0-dbeb4c3549c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89731fcb-59af-46bf-9644-d948af5ef943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:45:56 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Volume volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 (0d5f1ed7-d888-49c9-8291-68eb99fe2ce1): created successfully Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89731fcb-59af-46bf-9644-d948af5ef943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Flow 'volume_create_manager' (f7cdd55d-97c5-4de8-a8b6-916678c4650c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2ead3c2f-7284-47b1-ad0b-8faeb2947ba2 tempest-ServersNegativeTestJSON-1556650175 None] Created volume successfully. Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c79fe7-14bd-46d2-981e-ac705af093b0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:56 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:56 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "cinder-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "cinder-quobyte-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-quobyte-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e4726e-c96c-477d-aeb6-246653cbc6bb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:45:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:56 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 Jul 08 18:45:56 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:57 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 0.873s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:57 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8 Jul 08 18:45:57 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:57 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:57 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" returned: 0 in 1.027s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cd2dddc7-b51a-48f1-b690-666e74127fe8" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:57 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1 Jul 08 18:45:57 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-cd2dddc7-b51a-48f1-b690-666e74127fe8" released by "delete_volume" :: held 1.797s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['263196fa-8952-4ca4-8ae6-593d71b2fa88'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:58 devstack cinder-volume[87229]: WARNING cinder.db.api [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1150057454'] Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['af8c6cd1-3b5e-452a-926e-cb4ec1d75885', '6f402e53-7e1a-4e7b-bf5e-80920a178414', '2a94ea41-9354-406e-bb2d-82dd09c3c384', 'f30ccbfb-82c6-455e-9a67-7749a11e3814'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:58 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:58 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:45:59 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" returned: 0 in 1.442s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-quobyte-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1" released by "delete_volume" :: held 2.531s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Created reservations ['0bb02b8b-5e7b-4304-8d55-e9366858b5f1', 'fc8b6cf8-b514-4bd1-999b-509df1f4a011', 'ad3f3e7c-215b-4e11-b399-dc193a118f18', '881e5e44-af4f-4fd5-adc0-42fbde3c3eb8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:45:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-231a5a8f-4ef1-47cb-9697-6f0f6c2e0c74 tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-770468747: creating Jul 08 18:45:59 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 08 18:45:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-231a5a8f-4ef1-47cb-9697-6f0f6c2e0c74 tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-770468747: created successfully Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.072s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:45:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-553cd301-42b4-42f5-ae11-66687fee1a57 tempest-GroupSnapshotsTest-403874491 None] Delete group completed successfully. Jul 08 18:45:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-231a5a8f-4ef1-47cb-9697-6f0f6c2e0c74 tempest-GroupSnapshotsTest-403874491 None] Create group completed successfully. Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:45:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:45:59 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:45:59 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "cinder-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "cinder-quobyte-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-quobyte-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662da33-1cdf-4bf9-8f0d-e82a0cbf2479]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:00 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.706s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:00 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Deleted volume successfully. Jul 08 18:46:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9852fd5e-79f7-4527-9f89-7b43608055a8 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-0d5f1ed7-d888-49c9-8291-68eb99fe2ce1-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:00 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d Jul 08 18:46:00 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:01 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" returned: 0 in 0.877s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:01 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d Jul 08 18:46:01 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (2f31b2d5-acf6-4b1d-b813-0f4d6c2b2ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b497a5-3508-4b81-828b-7e90462f89d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b497a5-3508-4b81-828b-7e90462f89d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339602370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,host='devstack@QuobyteHD#QuobyteHD',id=52dc18a8-962d-4120-8031-87978b2b60a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:01Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb2984d-5b62-4446-a71f-2e03e9e92830),volume_type_id=7fb2984d-5b62-4446-a71f-2e03e9e92830)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359c0d5-fbe5-4f4c-80c1-b383193df79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a359c0d5-fbe5-4f4c-80c1-b383193df79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3309046-c015-4f30-8d52-d81b2aef939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3309046-c015-4f30-8d52-d81b2aef939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dc18a8-962d-4120-8031-87978b2b60a1', 'volume_name': 'volume-52dc18a8-962d-4120-8031-87978b2b60a1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5c2443-f383-4098-9d1d-88512ea01a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5c2443-f383-4098-9d1d-88512ea01a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858d242-a80a-44ca-84bd-09ade21d6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Volume 52dc18a8-962d-4120-8031-87978b2b60a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dc18a8-962d-4120-8031-87978b2b60a1', 'volume_size': 1} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,created_at=2026-07-08T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339602370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,host='devstack@QuobyteHD#QuobyteHD',id=52dc18a8-962d-4120-8031-87978b2b60a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:01Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb2984d-5b62-4446-a71f-2e03e9e92830),volume_type_id=7fb2984d-5b62-4446-a71f-2e03e9e92830)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Creating volume 52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:01 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:01 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 1073741824 Jul 08 18:46:01 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:01 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" returned: 0 in 0.694s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-quobyte-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d" released by "delete_volume" :: held 1.622s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Created reservations ['dedd3f76-875d-45c6-89fa-5bdf7b4b7cb3', 'a45ee4cc-9663-4533-b1b2-fdb4a3871531', '1a414a18-7134-4228-a7cb-77cb1dae8bb4', '47915beb-6301-4f9a-b3f6-b55a742fcd9c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:01 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:01 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:02 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 1073741824" returned: 0 in 0.862s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:02 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 Jul 08 18:46:02 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:02 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.775s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:02 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:02 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Deleted volume successfully. Jul 08 18:46:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b17a9e39-9703-49b3-ab46-2276c302e126 tempest-ServersNegativeTestJSON-1556650175 None] Lock "cinder-aeb08ffe-6c84-4f8f-8b8a-143ed70da48d-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:03 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1" returned: 0 in 0.851s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858d242-a80a-44ca-84bd-09ade21d6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dc18a8-962d-4120-8031-87978b2b60a1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85180ccd-ee5b-46e9-87fc-81af6c789b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Volume volume-52dc18a8-962d-4120-8031-87978b2b60a1 (52dc18a8-962d-4120-8031-87978b2b60a1): created successfully Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85180ccd-ee5b-46e9-87fc-81af6c789b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (2f31b2d5-acf6-4b1d-b813-0f4d6c2b2ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5325d050-897b-4874-8188-8bdaad15e892 tempest-GroupSnapshotsTest-403874491 None] Created volume successfully. Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (67a57908-7603-42c4-9c78-7685f31a298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91662631-6a4c-4a25-8557-28709250a590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (b88783ce-2b7d-49b9-bfbc-161d030c2f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119c57da-294c-4d4f-a5f0-17b9ab59aabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91662631-6a4c-4a25-8557-28709250a590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735240470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f34bfeb-7956-41d2-b565-fe76586b4c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:04Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2191bcfa-fd57-4687-9de6-e90a28922176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2191bcfa-fd57-4687-9de6-e90a28922176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d010f-277f-43ee-a11f-c2fa568093e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d010f-277f-43ee-a11f-c2fa568093e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f34bfeb-7956-41d2-b565-fe76586b4c8a', 'volume_name': 'volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb21a14-ef9c-4c82-9965-34027d353982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb21a14-ef9c-4c82-9965-34027d353982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0527ac77-bc90-4879-b06f-06f07ce6d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Volume 4f34bfeb-7956-41d2-b565-fe76586b4c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a', 'volume_size': 1} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735240470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f34bfeb-7956-41d2-b565-fe76586b4c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:04Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Creating volume 4f34bfeb-7956-41d2-b565-fe76586b4c8a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:04 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119c57da-294c-4d4f-a5f0-17b9ab59aabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1568441281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,host='devstack@QuobyteHD#QuobyteHD',id=a187f6c5-5959-46ed-aa37-3d1319259389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:04Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb2984d-5b62-4446-a71f-2e03e9e92830),volume_type_id=7fb2984d-5b62-4446-a71f-2e03e9e92830)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a 1073741824 Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cec075a-2e55-4688-a9b5-6a226e1ba399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cec075a-2e55-4688-a9b5-6a226e1ba399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2837901e-a6a0-4508-9cb6-daa016f767c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2837901e-a6a0-4508-9cb6-daa016f767c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a187f6c5-5959-46ed-aa37-3d1319259389', 'volume_name': 'volume-a187f6c5-5959-46ed-aa37-3d1319259389', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3840fe-0a6a-44fc-99fc-af0309109943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3840fe-0a6a-44fc-99fc-af0309109943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04605c7a-822f-4d55-bd6c-4bcdeabc64b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Volume a187f6c5-5959-46ed-aa37-3d1319259389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a187f6c5-5959-46ed-aa37-3d1319259389', 'volume_size': 1} Jul 08 18:46:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:05 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a 1073741824" returned: 0 in 1.020s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:05 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a Jul 08 18:46:05 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:06 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a" returned: 0 in 0.775s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,created_at=2026-07-08T16:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1568441281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5b24ba-cb94-4209-a2fc-8ddc7c584243,host='devstack@QuobyteHD#QuobyteHD',id=a187f6c5-5959-46ed-aa37-3d1319259389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:04Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb2984d-5b62-4446-a71f-2e03e9e92830),volume_type_id=7fb2984d-5b62-4446-a71f-2e03e9e92830)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Creating volume a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:06 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:06 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 1073741824 Jul 08 18:46:06 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0527ac77-bc90-4879-b06f-06f07ce6d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb40570-31a2-455b-b608-2604b90bacf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:06 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Volume volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a (4f34bfeb-7956-41d2-b565-fe76586b4c8a): created successfully Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb40570-31a2-455b-b608-2604b90bacf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (67a57908-7603-42c4-9c78-7685f31a298d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dda0c6bb-4f59-46d8-a43e-ff94a03836ce tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:46:07 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 1073741824" returned: 0 in 0.904s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:07 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 Jul 08 18:46:07 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-4f34bfeb-7956-41d2-b565-fe76586b4c8a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-4f34bfeb-7956-41d2-b565-fe76586b4c8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-quobyte-4f34bfeb-7956-41d2-b565-fe76586b4c8a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-4f34bfeb-7956-41d2-b565-fe76586b4c8a" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0f2f5e-645a-4ade-8b42-b6ac9aae22ee]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:07 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a Jul 08 18:46:07 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:08 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389" returned: 0 in 0.873s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04605c7a-822f-4d55-bd6c-4bcdeabc64b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a187f6c5-5959-46ed-aa37-3d1319259389', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacdb6db-3c42-4891-bb6f-83d9ac82bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Volume volume-a187f6c5-5959-46ed-aa37-3d1319259389 (a187f6c5-5959-46ed-aa37-3d1319259389): created successfully Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacdb6db-3c42-4891-bb6f-83d9ac82bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (b88783ce-2b7d-49b9-bfbc-161d030c2f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-399eb020-e2db-44e4-8a04-2d8517ddef2c tempest-GroupSnapshotsTest-403874491 None] Created volume successfully. Jul 08 18:46:08 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a" returned: 0 in 0.987s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:08 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a Jul 08 18:46:08 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9f9db524-4a1f-4961-b002-1a052c64f749 tempest-GroupSnapshotsTest-403874491 None] Update group completed successfully. Jul 08 18:46:09 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f34bfeb-7956-41d2-b565-fe76586b4c8a" returned: 0 in 0.803s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-4f34bfeb-7956-41d2-b565-fe76586b4c8a" released by "delete_volume" :: held 1.867s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Created reservations ['235f7f32-aa78-48c9-a98f-e3eef20b5113', '706cd68e-16b4-4ba0-aff3-00c7489d24ba', '1b496d67-7121-44b1-810e-cb656003350c', 'aa8850aa-3687-46e7-b4a4-c517e27d637b'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:09 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:09 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:10 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (a863f211-27ef-473d-a256-50fbc68aa864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60789ea0-7b41-448b-9ffe-6a399254299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.732s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60789ea0-7b41-448b-9ffe-6a399254299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1868649141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa46a3c-db8f-42fc-8635-ea4110a2067f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:10Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e592148-5d6f-4cc2-b9be-d7d5600af415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e592148-5d6f-4cc2-b9be-d7d5600af415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30427264-b561-49e8-a8cd-6dc1720bb60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30427264-b561-49e8-a8cd-6dc1720bb60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa46a3c-db8f-42fc-8635-ea4110a2067f', 'volume_name': 'volume-baa46a3c-db8f-42fc-8635-ea4110a2067f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10940f60-f8fe-424b-9b52-b8b62df91526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10940f60-f8fe-424b-9b52-b8b62df91526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899532c0-fa94-4002-bf65-f29048e9edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Volume baa46a3c-db8f-42fc-8635-ea4110a2067f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa46a3c-db8f-42fc-8635-ea4110a2067f', 'volume_size': 1} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1868649141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa46a3c-db8f-42fc-8635-ea4110a2067f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:10Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Creating volume baa46a3c-db8f-42fc-8635-ea4110a2067f {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:10 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Deleted volume successfully. Jul 08 18:46:10 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f 1073741824 Jul 08 18:46:10 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b316caa7-21cf-4dd3-8c45-f932052b18e9 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-4f34bfeb-7956-41d2-b565-fe76586b4c8a-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-88c0544d-c684-4456-8ba5-e284f21700c7 tempest-GroupSnapshotsTest-403874491 None] Update group completed successfully. Jul 08 18:46:11 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f 1073741824" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:11 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f Jul 08 18:46:11 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3103e7fb-796a-4f79-96c2-47284c1c727f tempest-GroupSnapshotsTest-403874491 None] Update group completed successfully. Jul 08 18:46:12 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f" returned: 0 in 0.719s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899532c0-fa94-4002-bf65-f29048e9edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa46a3c-db8f-42fc-8635-ea4110a2067f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a654837-06bf-4d9f-862e-73acec8aaae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Volume volume-baa46a3c-db8f-42fc-8635-ea4110a2067f (baa46a3c-db8f-42fc-8635-ea4110a2067f): created successfully Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a654837-06bf-4d9f-862e-73acec8aaae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (a863f211-27ef-473d-a256-50fbc68aa864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-49e89988-7e6d-4678-8082-08773ecd9d1f tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-baa46a3c-db8f-42fc-8635-ea4110a2067f-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-baa46a3c-db8f-42fc-8635-ea4110a2067f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-quobyte-baa46a3c-db8f-42fc-8635-ea4110a2067f" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-baa46a3c-db8f-42fc-8635-ea4110a2067f" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e18afb-0824-414a-8ce1-bbef3aa33f12]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:12 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f Jul 08 18:46:12 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c36114f9-d0fa-43a3-af1e-9ffe47c7628d tempest-GroupSnapshotsTest-403874491 None] Update group completed successfully. Jul 08 18:46:13 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f" returned: 0 in 0.920s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:13 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f Jul 08 18:46:13 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] GroupSnapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: creating. Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Group snapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: creating. {{(pid=87229) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:14 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-baa46a3c-db8f-42fc-8635-ea4110a2067f" returned: 0 in 0.913s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-baa46a3c-db8f-42fc-8635-ea4110a2067f" released by "delete_volume" :: held 1.916s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Creating offline snapshot 54187a72-0605-4ece-95ee-b800114f4cdb of volume 52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ffb09-a897-4725-b7e2-15dea392bf80]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Created reservations ['6dca913e-a7f8-47bf-8822-4547d0a740ac', '5213b8ea-5d05-48f1-a4ae-e55c38a4ff4c', '6c24a22b-ab64-4951-a6b2-d1312bfd0d37', '6e89904a-8e7b-494c-8754-af060dde48b1'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:14 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 Jul 08 18:46:14 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:14 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:14 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:15 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (41b2decc-ce71-4e6f-9992-3b7192ef064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0f3a51-674b-4576-a31f-f2d987a4a877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1" returned: 0 in 1.235s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:15 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb 1G Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0f3a51-674b-4576-a31f-f2d987a4a877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314293973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa6612b-2eb0-475e-9f2d-0c66c601cb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:15Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:15 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf4ff11-a675-4351-8f82-4cc991e267c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf4ff11-a675-4351-8f82-4cc991e267c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2def90b-e0c4-4432-8c10-2b3637ac3417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2def90b-e0c4-4432-8c10-2b3637ac3417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa6612b-2eb0-475e-9f2d-0c66c601cb20', 'volume_name': 'volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a694ea-2d71-4cca-9243-f736e9af2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a694ea-2d71-4cca-9243-f736e9af2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7776e229-f8fb-49e7-8aab-9c3a12eaefbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Volume eaa6612b-2eb0-475e-9f2d-0c66c601cb20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20', 'volume_size': 1} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:15 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.268s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Deleted volume successfully. Jul 08 18:46:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ddfbea3a-f4db-4f5d-8be6-cdc49d417ee7 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-baa46a3c-db8f-42fc-8635-ea4110a2067f-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:16 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb 1G" returned: 0 in 0.878s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52dc18a8-962d-4120-8031-87978b2b60a1 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:16 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52dc18a8-962d-4120-8031-87978b2b60a1 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb Jul 08 18:46:16 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-ffcf9215-3870-4435-82d1-d6f17ed758fa req-81562907-1497-4a8a-af57-0482fa104e10 tempest-AttachVolumeNegativeTest-901206521 None] Terminate volume connection completed successfully. Jul 08 18:46:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-ffcf9215-3870-4435-82d1-d6f17ed758fa req-81562907-1497-4a8a-af57-0482fa104e10 tempest-AttachVolumeNegativeTest-901206521 None] Deleting attachment 8d0ba623-ae17-423f-9270-71620c9b4828. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:46:17 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52dc18a8-962d-4120-8031-87978b2b60a1 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb" returned: 0 in 0.808s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:17 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:17 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb Jul 08 18:46:17 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:18 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:18 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:18 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:18 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info Jul 08 18:46:18 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:18 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.745s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 8 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:46:18 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info" returned: 0 in 0.732s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:18 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:18 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info Jul 08 18:46:18 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:19 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.info" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.373s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Creating offline snapshot 60985e86-7ed0-4962-b74c-7b2123dfef3e of volume a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ab33e8-6674-42ee-b6cc-cec6ce197f1e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:19 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 Jul 08 18:46:19 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:20 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389" returned: 0 in 0.818s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:20 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e 1G Jul 08 18:46:20 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:21 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e 1G" returned: 0 in 1.059s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a187f6c5-5959-46ed-aa37-3d1319259389 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:21 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a187f6c5-5959-46ed-aa37-3d1319259389 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e Jul 08 18:46:21 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:22 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a187f6c5-5959-46ed-aa37-3d1319259389 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e" returned: 0 in 0.949s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:22 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:22 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e Jul 08 18:46:22 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:23 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:23 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info Jul 08 18:46:23 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:24 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info" returned: 0 in 0.861s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:24 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:24 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info Jul 08 18:46:24 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:25 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.info" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.321s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.302s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314293973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa6612b-2eb0-475e-9f2d-0c66c601cb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:15Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Creating volume eaa6612b-2eb0-475e-9f2d-0c66c601cb20 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:25 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:25 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 1073741824 Jul 08 18:46:25 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0daa03d9-5bc7-46b4-9455-443a7ad8fed8 tempest-GroupSnapshotsTest-403874491 None] group_snapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: created successfully Jul 08 18:46:26 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 1073741824" returned: 0 in 0.977s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:26 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 Jul 08 18:46:26 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:26 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] group_snapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: deleting Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] group_snapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: deleting {{(pid=87229) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-54187a72-0605-4ece-95ee-b800114f4cdb" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-54187a72-0605-4ece-95ee-b800114f4cdb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Deleting offline snapshot 54187a72-0605-4ece-95ee-b800114f4cdb of volume 52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] snapshot_file for this snap is: volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f3b75-89ee-4c4c-acfb-9c18f2d417fd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:26 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb Jul 08 18:46:26 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:26 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" returned: 0 in 0.836s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7776e229-f8fb-49e7-8aab-9c3a12eaefbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48785d64-8047-449f-945e-cf916eb24d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:26 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Volume volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 (eaa6612b-2eb0-475e-9f2d-0c66c601cb20): created successfully Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48785d64-8047-449f-945e-cf916eb24d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (41b2decc-ce71-4e6f-9992-3b7192ef064e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-cdc2258c-3272-410f-9146-27baf165946f tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:46:27 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb" returned: 0 in 0.909s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52dc18a8-962d-4120-8031-87978b2b60a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca15d3-0102-4466-823e-c8e6804896bb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:27 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 Jul 08 18:46:27 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-eaa6612b-2eb0-475e-9f2d-0c66c601cb20-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "cinder-eaa6612b-2eb0-475e-9f2d-0c66c601cb20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-quobyte-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e95fba-edf5-4330-b0e4-bb977b347a4c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:27 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 Jul 08 18:46:27 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:28 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1" returned: 0 in 0.993s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:28 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb Jul 08 18:46:28 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:28 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" returned: 0 in 1.031s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:28 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20 Jul 08 18:46:28 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:29 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb" returned: 0 in 0.958s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:29 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb Jul 08 18:46:29 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:29 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" returned: 0 in 0.784s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-eaa6612b-2eb0-475e-9f2d-0c66c601cb20" released by "delete_volume" :: held 1.877s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Created reservations ['2dafb54a-a261-4d93-ab11-a0a1cc9bccf9', '1c84f0cd-6ecb-473d-8f0d-acff9e1c7d4c', 'e0217d41-978e-4f41-940f-41e73f63755f', '3b7acfc2-cf28-45f9-99cc-459c1b86d843'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:29 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:29 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:30 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1.54187a72-0605-4ece-95ee-b800114f4cdb" returned: 0 in 0.877s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-54187a72-0605-4ece-95ee-b800114f4cdb" released by "_delete_snapshot" :: held 3.927s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" released by "delete_snapshot" :: held 3.969s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-60985e86-7ed0-4962-b74c-7b2123dfef3e" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-60985e86-7ed0-4962-b74c-7b2123dfef3e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Deleting offline snapshot 60985e86-7ed0-4962-b74c-7b2123dfef3e of volume a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] snapshot_file for this snap is: volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee681b2-0591-4614-8487-cb32a75d570f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (364f39b5-e415-46aa-a5fc-5bd57debc7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf162fea-7bf3-4d60-a788-f3a267eefbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf162fea-7bf3-4d60-a788-f3a267eefbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1503243171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d288bc-3a5d-4fd0-9035-31a4f14d1211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:30Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8a238-169f-403d-8c8f-c9111a589f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c8a238-169f-403d-8c8f-c9111a589f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e Jul 08 18:46:30 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb5dcc-33f2-4b16-8aba-2add4c3943f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb5dcc-33f2-4b16-8aba-2add4c3943f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d288bc-3a5d-4fd0-9035-31a4f14d1211', 'volume_name': 'volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e66b098-bf95-4c5d-a636-c27b6a0fe52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e66b098-bf95-4c5d-a636-c27b6a0fe52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182db5bd-48c3-499d-8425-1dcbdd0aee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:30 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Volume a2d288bc-3a5d-4fd0-9035-31a4f14d1211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211', 'volume_size': 1} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1503243171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d288bc-3a5d-4fd0-9035-31a4f14d1211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:30Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Creating volume a2d288bc-3a5d-4fd0-9035-31a4f14d1211 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:30 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:30 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 1073741824 Jul 08 18:46:30 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:30 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.995s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:30 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Deleted volume successfully. Jul 08 18:46:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11cd38de-8d7f-4c8d-a6d8-d6ab206f0a6d tempest-VolumesActionsTest-2119170412 None] Lock "cinder-eaa6612b-2eb0-475e-9f2d-0c66c601cb20-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:31 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e" returned: 0 in 0.972s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a187f6c5-5959-46ed-aa37-3d1319259389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad61d0d-a27b-468d-accf-2817c9eb7258]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:31 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 Jul 08 18:46:31 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:31 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 1073741824" returned: 0 in 1.221s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:31 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 Jul 08 18:46:31 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:32 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389" returned: 0 in 0.887s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:32 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e Jul 08 18:46:32 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:32 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" returned: 0 in 0.832s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182db5bd-48c3-499d-8425-1dcbdd0aee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11675a5-6c31-4b2e-b406-4a85df06fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:32 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Volume volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 (a2d288bc-3a5d-4fd0-9035-31a4f14d1211): created successfully Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11675a5-6c31-4b2e-b406-4a85df06fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (364f39b5-e415-46aa-a5fc-5bd57debc7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5a743f7d-0611-4915-9733-ce5c14202591 tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:46:33 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e" returned: 0 in 0.971s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:33 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e Jul 08 18:46:33 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-a2d288bc-3a5d-4fd0-9035-31a4f14d1211-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-a2d288bc-3a5d-4fd0-9035-31a4f14d1211-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "cinder-quobyte-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a051b-4643-421b-b35f-3fd50ebc8d16]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:34 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389.60985e86-7ed0-4962-b74c-7b2123dfef3e" returned: 0 in 0.819s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-60985e86-7ed0-4962-b74c-7b2123dfef3e" released by "_delete_snapshot" :: held 3.833s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" released by "delete_snapshot" :: held 3.862s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:34 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 Jul 08 18:46:34 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:34 devstack cinder-volume[87229]: WARNING cinder.quota [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1941525109 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1941525109, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:34 devstack cinder-volume[87229]: WARNING cinder.quota [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1941525109 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1941525109, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Created reservations ['c328c814-c2a3-4005-8d67-dd223fef971d', '995e30d2-266c-4f1f-88c6-39c48ff1439a', 'f29df10b-e46a-4f8b-be2a-79eb62c05849', '7abab148-65b9-48fa-a476-d78a564df7f4'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] Created reservations ['e3ff46c8-ce1d-45c3-98a2-c076ca96a18d', '4a32eb18-5420-4c00-a860-a9f20b65a218', 'fd0dba0b-a544-459f-b2bd-a34541a00fe8', 'fd66ba9a-8703-4d5e-96ab-e7e17685800b'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dd87810a-cfda-4652-a32c-9412fe6fbf1d tempest-GroupSnapshotsTest-403874491 None] group_snapshot b55d6c0f-961e-4fc4-8007-566aa3e62314: deleted successfully Jul 08 18:46:34 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" returned: 0 in 0.801s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:34 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211 Jul 08 18:46:34 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a03734-d62e-4ec6-89ac-d1d7f5c0aa36]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:35 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" returned: 0 in 0.719s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-quobyte-a2d288bc-3a5d-4fd0-9035-31a4f14d1211" released by "delete_volume" :: held 1.566s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Created reservations ['0dc935e3-7b8c-4ba2-aea0-0afaed3e3eb4', '6e990e68-3da5-4124-a2e2-156b7861188d', '44605d2e-b493-4c24-bc64-1632f584e5cc', '91e2cc13-f3c8-463f-a732-d86f1ac6d1b5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:35 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 Jul 08 18:46:35 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:35 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:35 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:36 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1" returned: 0 in 0.902s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:36 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Deleted volume successfully. Jul 08 18:46:36 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1 Jul 08 18:46:36 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2edae5ce-fa54-4874-a071-a0558c394d56 tempest-VolumesActionsTest-2119170412 None] Lock "cinder-a2d288bc-3a5d-4fd0-9035-31a4f14d1211-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (6199181b-7e84-4ebb-92a5-667ca25bdd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6658716f-0339-4e70-a2c1-b9c4e0bb384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6658716f-0339-4e70-a2c1-b9c4e0bb384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749383393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43478344-eb53-462a-944d-1c3f46e3263b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:37Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a041e5-9974-44cb-9118-d18710298725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a041e5-9974-44cb-9118-d18710298725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38772d2f-f676-47fd-b8cd-90fc715cb8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38772d2f-f676-47fd-b8cd-90fc715cb8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43478344-eb53-462a-944d-1c3f46e3263b', 'volume_name': 'volume-43478344-eb53-462a-944d-1c3f46e3263b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bdb7c-6657-4ea4-9946-6c072675bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bdb7c-6657-4ea4-9946-6c072675bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2095fbc-1047-4640-9105-7e9e0ece0a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Volume 43478344-eb53-462a-944d-1c3f46e3263b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43478344-eb53-462a-944d-1c3f46e3263b', 'volume_size': 1} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749383393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43478344-eb53-462a-944d-1c3f46e3263b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace649628a4545cf8fa4b48491fab716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:37Z,use_quota=True,user_id='0a956d7f879f4c1593b8cb159ac66dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Creating volume 43478344-eb53-462a-944d-1c3f46e3263b {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:36 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:36 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b 1073741824 Jul 08 18:46:36 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:37 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52dc18a8-962d-4120-8031-87978b2b60a1" returned: 0 in 0.821s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-52dc18a8-962d-4120-8031-87978b2b60a1" released by "delete_volume" :: held 1.823s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76168b2c-6dcf-4e72-b4d3-572751bb331b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:37 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 Jul 08 18:46:37 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:38 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b 1073741824" returned: 0 in 1.168s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:38 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b Jul 08 18:46:38 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:38 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389" returned: 0 in 1.007s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:38 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389 Jul 08 18:46:38 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:39 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2095fbc-1047-4640-9105-7e9e0ece0a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43478344-eb53-462a-944d-1c3f46e3263b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6bbd3-a89d-4efa-8cf7-e2ce98d2c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:39 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Volume volume-43478344-eb53-462a-944d-1c3f46e3263b (43478344-eb53-462a-944d-1c3f46e3263b): created successfully Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6bbd3-a89d-4efa-8cf7-e2ce98d2c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Flow 'volume_create_manager' (6199181b-7e84-4ebb-92a5-667ca25bdd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a363dfcc-7a52-4587-815a-213b1c1a6609 tempest-VolumesActionsTest-1710871339 None] Created volume successfully. Jul 08 18:46:39 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a187f6c5-5959-46ed-aa37-3d1319259389" returned: 0 in 1.019s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-a187f6c5-5959-46ed-aa37-3d1319259389" released by "delete_volume" :: held 2.112s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['12e0a3da-e002-4382-9df4-d1f7fcd15641'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:39 devstack cinder-volume[87229]: WARNING cinder.quota [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1941525109 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1941525109, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['dc988439-f89a-4723-bda3-0ae47f0f5e0c', 'c3955514-c3f1-4109-adf6-9ec0dceeb017', '62c97a43-36a4-421e-af72-6bb742faf09e', '7bba4a96-fa4a-4b46-9165-aa8fc3eca969'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['9be96271-ae00-4278-a85c-21529d8a8727', '88d8c77d-839a-4177-8e72-276703f3ff09', '16f559bd-825f-4dd1-9d8f-87089758093b', '0508751b-f5b6-4e70-b5d0-9de94691f06c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:39 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:39 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:40 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.026s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:40 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-faf0c4ef-9085-436d-bba6-ab2b2e582114 tempest-GroupSnapshotsTest-403874491 None] Delete group completed successfully. Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-43478344-eb53-462a-944d-1c3f46e3263b-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-43478344-eb53-462a-944d-1c3f46e3263b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=133,cinder:UPDATE=146,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:46:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-aeb1b52a-684e-4083-9857-a46645ffd7c0 tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-1325746944: creating Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "cinder-quobyte-43478344-eb53-462a-944d-1c3f46e3263b" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-aeb1b52a-684e-4083-9857-a46645ffd7c0 tempest-GroupSnapshotsTest-403874491 None] Group tempest-GroupSnapshotsTest-Group-1325746944: created successfully Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-quobyte-43478344-eb53-462a-944d-1c3f46e3263b" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-aeb1b52a-684e-4083-9857-a46645ffd7c0 tempest-GroupSnapshotsTest-403874491 None] Create group completed successfully. Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e0d57a-10f0-4a06-b828-9c65b1ad1ec3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:41 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b Jul 08 18:46:41 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:42 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b" returned: 0 in 0.954s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:42 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b Jul 08 18:46:42 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=173,cinder:SELECT=134,cinder:INSERT=36,cinder:DELETE=5 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (cb6f4c09-3ccb-430d-a64c-494fd363425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4e67f8-ea28-4fba-a71e-46971ecbaa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4e67f8-ea28-4fba-a71e-46971ecbaa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536427971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9554eceb-aa79-4d31-bf03-e1832a4cbf2e,host='devstack@QuobyteHD#QuobyteHD',id=d2bf1084-f2ef-4d20-85fe-6d1f24d1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:43Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0c53f7b-63cc-4f9e-9304-1b059bff1eaa),volume_type_id=a0c53f7b-63cc-4f9e-9304-1b059bff1eaa)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771b3202-374e-40eb-831a-440fe0e3dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771b3202-374e-40eb-831a-440fe0e3dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0133876-0b20-40fd-987a-9e3c43544880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0133876-0b20-40fd-987a-9e3c43544880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bf1084-f2ef-4d20-85fe-6d1f24d1164c', 'volume_name': 'volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c33e73-7e8d-4a58-87dc-4014766b52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c33e73-7e8d-4a58-87dc-4014766b52f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7227ff-1640-4188-88fa-ec74f592dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Volume d2bf1084-f2ef-4d20-85fe-6d1f24d1164c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c', 'volume_size': 1} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9554eceb-aa79-4d31-bf03-e1832a4cbf2e,created_at=2026-07-08T16:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536427971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9554eceb-aa79-4d31-bf03-e1832a4cbf2e,host='devstack@QuobyteHD#QuobyteHD',id=d2bf1084-f2ef-4d20-85fe-6d1f24d1164c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04bd3f32f0dd4610a59753be0b849a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:46:43Z,use_quota=True,user_id='c4d05623e1764f6ebd9c78cb50743255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0c53f7b-63cc-4f9e-9304-1b059bff1eaa),volume_type_id=a0c53f7b-63cc-4f9e-9304-1b059bff1eaa)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Creating volume d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:46:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:43 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c 1073741824 Jul 08 18:46:43 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:43 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-43478344-eb53-462a-944d-1c3f46e3263b" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-quobyte-43478344-eb53-462a-944d-1c3f46e3263b" released by "delete_volume" :: held 1.844s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Created reservations ['5a903a0b-87e8-475a-8eb0-5c132e5f203e', '90da8403-b449-4b1a-b785-640c1a1d41b5', '69003847-7408-4740-bdbe-3d7328107cde', '35f2cbda-6f52-45cf-96ff-9434ca5d6d15'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:43 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:46:43 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:44 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:44 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:46:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Deleted volume successfully. Jul 08 18:46:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0408dafd-3e4b-45dd-a4be-a29c4995aac0 tempest-VolumesActionsTest-1710871339 None] Lock "cinder-43478344-eb53-462a-944d-1c3f46e3263b-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:46:44 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c 1073741824" returned: 0 in 1.355s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:44 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c Jul 08 18:46:44 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:45 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" returned: 0 in 0.727s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7227ff-1640-4188-88fa-ec74f592dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a670028-ac72-4a01-96c7-b35da49c0d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:46:45 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Volume volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c (d2bf1084-f2ef-4d20-85fe-6d1f24d1164c): created successfully Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a670028-ac72-4a01-96c7-b35da49c0d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:46:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Flow 'volume_create_manager' (cb6f4c09-3ccb-430d-a64c-494fd363425a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:46:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c6dd2054-9e16-4b67-a583-7e08f5667eb6 tempest-GroupSnapshotsTest-403874491 None] Created volume successfully. Jul 08 18:46:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] GroupSnapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: creating. Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Group snapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: creating. {{(pid=87229) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Creating offline snapshot b3609046-3cd1-4670-ab3d-aa1508f4ecd2 of volume d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde00e04-e080-4b37-bbd8-95a029e7dacd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:47 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c Jul 08 18:46:47 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:48 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" returned: 0 in 1.274s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:48 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 1G Jul 08 18:46:48 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:50 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 1G" returned: 0 in 1.695s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:50 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 Jul 08 18:46:50 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:52 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2" returned: 0 in 1.469s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:52 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:52 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 Jul 08 18:46:52 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:53 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2" returned: 0 in 1.208s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:53 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info Jul 08 18:46:53 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:54 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info" returned: 0 in 1.064s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:54 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:46:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:54 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info Jul 08 18:46:54 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:55 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.info" returned: 0 in 1.570s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.450s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:46:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5ba9292b-19c8-44e2-b0e7-4335688aa6dd tempest-GroupSnapshotsTest-403874491 None] group_snapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: created successfully Jul 08 18:46:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] group_snapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: deleting Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] group_snapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: deleting {{(pid=87229) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-b3609046-3cd1-4670-ab3d-aa1508f4ecd2" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-b3609046-3cd1-4670-ab3d-aa1508f4ecd2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Deleting offline snapshot b3609046-3cd1-4670-ab3d-aa1508f4ecd2 of volume d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] snapshot_file for this snap is: volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e46ac3-6608-475a-a3c0-300c37707b20]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:57 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 Jul 08 18:46:57 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:57 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2" returned: 0 in 1.229s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:46:57 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea54b816-68e5-4c8e-8b44-ad487f02352d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:46:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:58 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c Jul 08 18:46:58 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:58 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" returned: 0 in 0.957s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:58 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 Jul 08 18:46:58 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:46:59 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jul 08 18:46:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:46:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:46:59 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2 Jul 08 18:46:59 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:00 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c.b3609046-3cd1-4670-ab3d-aa1508f4ecd2" returned: 0 in 0.848s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-b3609046-3cd1-4670-ab3d-aa1508f4ecd2" released by "_delete_snapshot" :: held 4.192s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" released by "delete_snapshot" :: held 4.230s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:00 devstack cinder-volume[87229]: WARNING cinder.quota [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-272029184 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-272029184, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:47:00 devstack cinder-volume[87229]: WARNING cinder.quota [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-272029184 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-272029184, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:47:00 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['108ae3ce-8994-4f48-a281-01877cd4d32e', 'b0489ad6-89da-431b-8922-72a66d1531f1', 'a2517d77-134c-4906-9633-2cb912b45505', '3c9f6deb-42e2-404c-a97e-59e186089b47'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8528514e-b5d5-412f-ad2f-145ddf899946 tempest-GroupSnapshotsTest-403874491 None] group_snapshot 9c42d255-6e21-4ee1-9e95-a37da8345712: deleted successfully Jul 08 18:47:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ce94e-c41a-429c-978f-fb2d6c69a19d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:01 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c Jul 08 18:47:01 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" returned: 0 in 0.861s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:02 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c Jul 08 18:47:02 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Flow 'volume_create_manager' (e9c03bc9-e841-47bc-9f87-55fef59b169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c83e7-2e04-4f91-908b-bd20b4fb0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c83e7-2e04-4f91-908b-bd20b4fb0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-788643141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab09aae6-2689-4d14-9051-96ce336385d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a125fe7fd694b07a10397142a076462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:03Z,use_quota=True,user_id='17abda9711374789b5c946c5f0fdc01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d7207e-4b65-40b9-8746-6d2cd83a6bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d7207e-4b65-40b9-8746-6d2cd83a6bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61064f97-a8c2-40b3-a46e-6fefb21e0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:02 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:47:03 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" returned: 0 in 0.854s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Lock "cinder-quobyte-d2bf1084-f2ef-4d20-85fe-6d1f24d1164c" released by "delete_volume" :: held 1.802s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61064f97-a8c2-40b3-a46e-6fefb21e0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab09aae6-2689-4d14-9051-96ce336385d1', 'volume_name': 'volume-ab09aae6-2689-4d14-9051-96ce336385d1', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c73a7d-6610-4dde-953b-2201df6440a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c73a7d-6610-4dde-953b-2201df6440a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a28d78-fb03-494d-9129-cf7ec895acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Volume ab09aae6-2689-4d14-9051-96ce336385d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab09aae6-2689-4d14-9051-96ce336385d1', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Trying to clone ab09aae6-2689-4d14-9051-96ce336385d1 from image dd434acf-5aa9-44c3-8328-d41e2c476c9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['5d09a7df-f447-4664-ba3b-2a3cff05f096'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:03 devstack cinder-volume[87229]: WARNING cinder.quota [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-272029184 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-272029184, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Created reservations ['9ce762fa-96bc-4efd-8167-c8a97c675f66', '2521ad39-d230-43fa-ae00-540f0f44017a', '3d847e49-9585-42bf-939b-d3b7c5a191dc', '8fd2fcc6-da2a-4e93-a157-8e2812cc38e0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:03 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:03 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:47:03 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe538a5-aa66-42d6-8d66-4894ae758d57]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:04 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD Jul 08 18:47:04 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:04 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.712s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8028e347-7160-4c5e-997f-3bad9359b8d7 tempest-GroupSnapshotsTest-403874491 None] Delete group completed successfully. Jul 08 18:47:04 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a is fetched for user 17abda9711374789b5c946c5f0fdc01a. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e25ebe4-7997-486d-a200-f1dfc4681513]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:04 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD Jul 08 18:47:04 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:05 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-788643141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab09aae6-2689-4d14-9051-96ce336385d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a125fe7fd694b07a10397142a076462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:03Z,use_quota=True,user_id='17abda9711374789b5c946c5f0fdc01a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Creating volume ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:05 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:05 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1073741824 Jul 08 18:47:05 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:06 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1073741824" returned: 0 in 0.867s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:06 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:06 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:07 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Attempting download of dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume ab09aae6-2689-4d14-9051-96ce336385d1. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d07796-cfd3-439c-a35d-7ead37d45904]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:07 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8 Jul 08 18:47:07 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:08 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:08 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8 Jul 08 18:47:08 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:08 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8" returned: 1 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_hun8dzo8' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc65b3-ebca-4689-a900-c6b0a4257a99]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:08 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD Jul 08 18:47:08 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d81ed1f5-36ec-4433-9327-b48cae45ca53 tempest-GroupsV314Test-1702633851 None] Group tempest-GroupsV314Test-Group-1083092243: creating Jul 08 18:47:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d81ed1f5-36ec-4433-9327-b48cae45ca53 tempest-GroupsV314Test-1702633851 None] Group tempest-GroupsV314Test-Group-1083092243: created successfully Jul 08 18:47:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d81ed1f5-36ec-4433-9327-b48cae45ca53 tempest-GroupsV314Test-1702633851 None] Create group completed successfully. Jul 08 18:47:09 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:09 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] dd434acf-5aa9-44c3-8328-d41e2c476c9a was qcow2, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:47:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:09 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:09 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Flow 'volume_create_manager' (d07e6936-b748-415f-8f53-4ed5b4cbf91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67755b26-e4e1-43a1-8d26-d2071af7f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67755b26-e4e1-43a1-8d26-d2071af7f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-454879819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb4449e4-17d9-4e42-9332-7e2c85b896de,host='devstack@QuobyteHD#QuobyteHD',id=0418ca96-4e48-441e-b429-1865761adc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d30f8a4c1c9484c93de538a527e40ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:11Z,use_quota=True,user_id='7a4208f9ced9404cab2ae06f351eb436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450c00a3-02b7-4e99-9d94-d7b2cb1ea19c),volume_type_id=450c00a3-02b7-4e99-9d94-d7b2cb1ea19c)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d2447-9023-48a8-9979-3eba532a1a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d2447-9023-48a8-9979-3eba532a1a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe76266-f6f0-46c4-8d53-ad31f1b1a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe76266-f6f0-46c4-8d53-ad31f1b1a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0418ca96-4e48-441e-b429-1865761adc7a', 'volume_name': 'volume-0418ca96-4e48-441e-b429-1865761adc7a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93701a21-63c6-4cc5-9e91-393b6a0d9981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93701a21-63c6-4cc5-9e91-393b6a0d9981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de31cc8-2ef0-4671-aa82-8cb14b5e13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Volume 0418ca96-4e48-441e-b429-1865761adc7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0418ca96-4e48-441e-b429-1865761adc7a', 'volume_size': 1} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cb4449e4-17d9-4e42-9332-7e2c85b896de,created_at=2026-07-08T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-454879819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb4449e4-17d9-4e42-9332-7e2c85b896de,host='devstack@QuobyteHD#QuobyteHD',id=0418ca96-4e48-441e-b429-1865761adc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d30f8a4c1c9484c93de538a527e40ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:11Z,use_quota=True,user_id='7a4208f9ced9404cab2ae06f351eb436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(450c00a3-02b7-4e99-9d94-d7b2cb1ea19c),volume_type_id=450c00a3-02b7-4e99-9d94-d7b2cb1ea19c)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Creating volume 0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:10 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:11 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a 1073741824 Jul 08 18:47:11 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:11 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 0 in 2.183s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:11 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a__xo31aurdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:47:11 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Converted 112.00 MB image at 51.29 MB/s Jul 08 18:47:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:11 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1G Jul 08 18:47:11 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:11 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a 1073741824" returned: 0 in 0.987s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:12 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:12 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Flow 'volume_create_manager' (c6eca361-5030-4b9e-aeb5-efdf0f02cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783ce71-e9a4-46f1-820c-4fb44d1ea3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f783ce71-e9a4-46f1-820c-4fb44d1ea3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1276529478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b7ea00-e9f2-403e-bf56-6f6e700072c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07be146a30d443ca41d315ca16d6b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:12Z,use_quota=True,user_id='2642762d28fd4744a2ea563e610032e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c2fcad-7c50-47f3-aabd-22f129b9691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c2fcad-7c50-47f3-aabd-22f129b9691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baeb63-e717-4356-aeb8-c3fe56268614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baeb63-e717-4356-aeb8-c3fe56268614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b7ea00-e9f2-403e-bf56-6f6e700072c4', 'volume_name': 'volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad96e95-3576-43e8-9f6d-9702df1b793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad96e95-3576-43e8-9f6d-9702df1b793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc1a4c7-f47d-45ee-8b2d-0afb09b0b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Volume 21b7ea00-e9f2-403e-bf56-6f6e700072c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4', 'volume_size': 1} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:12 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 1G" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6f824d-2ff4-4d3e-becf-f366fcf7927f]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:12 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:12 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:12 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1276529478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b7ea00-e9f2-403e-bf56-6f6e700072c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07be146a30d443ca41d315ca16d6b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:12Z,use_quota=True,user_id='2642762d28fd4744a2ea563e610032e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Creating volume 21b7ea00-e9f2-403e-bf56-6f6e700072c4 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:12 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:12 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 1073741824 Jul 08 18:47:12 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de31cc8-2ef0-4671-aa82-8cb14b5e13fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0418ca96-4e48-441e-b429-1865761adc7a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822b3fdb-5a64-455a-ae73-d61076d5c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Volume volume-0418ca96-4e48-441e-b429-1865761adc7a (0418ca96-4e48-441e-b429-1865761adc7a): created successfully Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822b3fdb-5a64-455a-ae73-d61076d5c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Flow 'volume_create_manager' (d07e6936-b748-415f-8f53-4ed5b4cbf91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8d9d881e-d0e7-4234-a53c-812c24993921 tempest-GroupsV314Test-1702633851 None] Created volume successfully. Jul 08 18:47:13 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:13 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:13 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:13 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 1073741824" returned: 0 in 0.893s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:13 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 Jul 08 18:47:13 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:14 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 1 in 0.820s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Downloaded image dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume ab09aae6-2689-4d14-9051-96ce336385d1 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a for user 17abda9711374789b5c946c5f0fdc01a is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Marking volume ab09aae6-2689-4d14-9051-96ce336385d1 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Copying metadata from image dd434acf-5aa9-44c3-8328-d41e2c476c9a to ab09aae6-2689-4d14-9051-96ce336385d1. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Creating volume glance metadata for volume ab09aae6-2689-4d14-9051-96ce336385d1 backed by image dd434acf-5aa9-44c3-8328-d41e2c476c9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a28d78-fb03-494d-9129-cf7ec895acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab09aae6-2689-4d14-9051-96ce336385d1', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad01bb84-ba5f-4e03-9eb1-c8042abdb4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Volume volume-ab09aae6-2689-4d14-9051-96ce336385d1 (ab09aae6-2689-4d14-9051-96ce336385d1): created successfully Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad01bb84-ba5f-4e03-9eb1-c8042abdb4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Flow 'volume_create_manager' (e9c03bc9-e841-47bc-9f87-55fef59b169e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5cc419c9-f90f-4025-9a84-2e55bb858f26 tempest-VolumesImageMetadata-1702737887 None] Created volume successfully. Jul 08 18:47:14 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc1a4c7-f47d-45ee-8b2d-0afb09b0b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64f36e0-7c94-4092-accb-e4b806b0c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Volume volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 (21b7ea00-e9f2-403e-bf56-6f6e700072c4): created successfully Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64f36e0-7c94-4092-accb-e4b806b0c96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Flow 'volume_create_manager' (c6eca361-5030-4b9e-aeb5-efdf0f02cf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:14 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Cloning volume 0418ca96-4e48-441e-b429-1865761adc7a to volume e796ba18-77ba-40ed-85ef-6ffb0376ae83 Jul 08 18:47:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dfeb91b1-8dd7-486b-a19a-7b36bee56a0d tempest-AttachVolumeShelveTestJSON-272907787 None] Created volume successfully. Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Creating offline snapshot c61c93b7-ccc8-490c-b163-c75e5caa835e of volume 0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[089308de-e682-4191-b9dd-504c63034283]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:14 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:14 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (02386440-177a-4c98-947b-2d43957b83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25c1c3e-7f28-48df-b99c-9f46d5b8b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25c1c3e-7f28-48df-b99c-9f46d5b8b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2085482487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcd97c0-e004-4fa4-a54c-ff387d2cc10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:15Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1260a47a-9419-484a-a7ab-50b410ea607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1260a47a-9419-484a-a7ab-50b410ea607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e4294-2fa8-4942-af66-4467d68fd4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e4294-2fa8-4942-af66-4467d68fd4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcd97c0-e004-4fa4-a54c-ff387d2cc10a', 'volume_name': 'volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd4c20-9743-435c-b393-f0dadcd3e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd4c20-9743-435c-b393-f0dadcd3e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aca6fb9-9c12-4ce4-bbe9-7c582b6b1550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Volume 4dcd97c0-e004-4fa4-a54c-ff387d2cc10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a', 'volume_size': 1} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Acquiring lock "cinder-ab09aae6-2689-4d14-9051-96ce336385d1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "cinder-ab09aae6-2689-4d14-9051-96ce336385d1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Acquiring lock "cinder-quobyte-ab09aae6-2689-4d14-9051-96ce336385d1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "cinder-quobyte-ab09aae6-2689-4d14-9051-96ce336385d1" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14b4c6-e7c9-426c-af6f-463a7d20506a]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:15 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:15 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:15 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.891s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:15 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e 1G Jul 08 18:47:15 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:16 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 0 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:16 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:16 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:16 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e 1G" returned: 0 in 0.906s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0418ca96-4e48-441e-b429-1865761adc7a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:16 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0418ca96-4e48-441e-b429-1865761adc7a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:16 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:16 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 1 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:47:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:16 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1 Jul 08 18:47:16 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:17 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0418ca96-4e48-441e-b429-1865761adc7a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.752s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:17 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:17 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:17 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:17 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ab09aae6-2689-4d14-9051-96ce336385d1" returned: 0 in 0.727s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "cinder-quobyte-ab09aae6-2689-4d14-9051-96ce336385d1" released by "delete_volume" :: held 2.436s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Created reservations ['efe6b761-71d2-4b29-ba9a-b99102a29835', '227b1183-0203-418d-a3c7-c89ee2ad61c0', 'ff136422-553b-4e48-97cb-02173e63ffb5', '619baa42-8a8b-4ec0-a31f-5441e4d25003'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:17 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:17 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:17 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:17 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info Jul 08 18:47:17 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:18 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:18 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:18 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.847s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Deleted volume successfully. Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5aa5c22e-2955-43d8-896d-136829f9c258 tempest-VolumesImageMetadata-1702737887 None] Lock "cinder-ab09aae6-2689-4d14-9051-96ce336385d1-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:18 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:18 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:18 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info Jul 08 18:47:18 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:18 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.759s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:47:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:47:19 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.info" returned: 0 in 0.688s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Acquiring lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] snapshot: c61c93b7-ccc8-490c-b163-c75e5caa835e, volume: e796ba18-77ba-40ed-85ef-6ffb0376ae83, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5b9d9a-5709-47f7-9b63-550fb3e3e429]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:19 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:19 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:20 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.846s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0418ca96-4e48-441e-b429-1865761adc7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e9bd2-7ba5-43e6-9430-589d5e98c0b9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:20 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:20 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:21 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.840s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:21 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:47:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:21 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 Jul 08 18:47:21 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Flow 'volume_create_manager' (872e880a-eb9e-491c-95f3-70128181b626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960167c4-773f-4332-9816-3bb02c3b4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960167c4-773f-4332-9816-3bb02c3b4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1331106176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db01ab89-2b64-4012-8ca1-398798733d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0386f803059b4664abf39f89650a38a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:24Z,use_quota=True,user_id='ef256ce971b8494d9c2fdf11e3b5e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d600173b-2135-459f-8859-f6d259dc7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d600173b-2135-459f-8859-f6d259dc7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1313422-eac7-411f-8ce1-d1b3a1b1f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1313422-eac7-411f-8ce1-d1b3a1b1f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db01ab89-2b64-4012-8ca1-398798733d6d', 'volume_name': 'volume-db01ab89-2b64-4012-8ca1-398798733d6d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32470a2c-0595-4d65-99e3-a6b3e4e0e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32470a2c-0595-4d65-99e3-a6b3e4e0e959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4be410-eae1-4356-a83c-1f694b6b8111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Volume db01ab89-2b64-4012-8ca1-398798733d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db01ab89-2b64-4012-8ca1-398798733d6d', 'volume_size': 1} Jul 08 18:47:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:26 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83" returned: 0 in 5.606s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:26 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3205da-a209-4173-ab19-39e4ce3321fc]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:26 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:26 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:27 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:27 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:47:27 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Converted 1024.00 MB image at 182.62 MB/s Jul 08 18:47:27 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:47:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:27 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 Jul 08 18:47:27 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:28 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83" returned: 0 in 0.710s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" released by "_copy_volume_from_snapshot" :: held 9.094s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Acquiring lock "cinder-quobyte-c61c93b7-ccc8-490c-b163-c75e5caa835e" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-c61c93b7-ccc8-490c-b163-c75e5caa835e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Deleting offline snapshot c61c93b7-ccc8-490c-b163-c75e5caa835e of volume 0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] snapshot_file for this snap is: volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5db0c7-d330-4cb3-b87c-03a1d1abafb6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:28 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:28 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:29 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.754s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0418ca96-4e48-441e-b429-1865761adc7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:47:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd56f5-73d7-4a8b-babc-5b3505b742f8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:29 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:29 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:30 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.815s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:30 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:30 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:30 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.796s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:30 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e Jul 08 18:47:30 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:31 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a.c61c93b7-ccc8-490c-b163-c75e5caa835e" returned: 0 in 0.815s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-c61c93b7-ccc8-490c-b163-c75e5caa835e" released by "_delete_snapshot" :: held 3.274s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.299s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.799s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2085482487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcd97c0-e004-4fa4-a54c-ff387d2cc10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:15Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Creating volume 4dcd97c0-e004-4fa4-a54c-ff387d2cc10a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:31 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:31 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a 1073741824 Jul 08 18:47:31 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9cb21c7c-88cd-4432-92c1-45577071c206 tempest-GroupsV314Test-1702633851 None] Create group from source-group-cb4449e4-17d9-4e42-9332-7e2c85b896de completed successfully. Jul 08 18:47:32 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a 1073741824" returned: 0 in 1.016s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Acquiring lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d85e30-2f94-4860-bb58-bbfa77c0fe22]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:32 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a Jul 08 18:47:32 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:33 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 Jul 08 18:47:33 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-142738d1-f8ab-4845-9a97-0fe9fa510664 req-14265e8b-cf36-4456-850c-73e6b18a3253 tempest-AttachVolumeShelveTestJSON-272907787 None] No connector for attachment 0765b017-5eb0-4e3d-8859-8901b091d1cc; skipping storage backend terminate_connection call. {{(pid=87229) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-142738d1-f8ab-4845-9a97-0fe9fa510664 req-14265e8b-cf36-4456-850c-73e6b18a3253 tempest-AttachVolumeShelveTestJSON-272907787 None] Deleting attachment 0765b017-5eb0-4e3d-8859-8901b091d1cc. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:47:33 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.208s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1331106176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db01ab89-2b64-4012-8ca1-398798733d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0386f803059b4664abf39f89650a38a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:24Z,use_quota=True,user_id='ef256ce971b8494d9c2fdf11e3b5e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Creating volume db01ab89-2b64-4012-8ca1-398798733d6d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:33 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aca6fb9-9c12-4ce4-bbe9-7c582b6b1550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d 1073741824 Jul 08 18:47:33 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c728930-cf06-4acb-bb94-17a0b69b76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Volume volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a (4dcd97c0-e004-4fa4-a54c-ff387d2cc10a): created successfully Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c728930-cf06-4acb-bb94-17a0b69b76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (02386440-177a-4c98-947b-2d43957b83fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-682eebfa-85a9-46ad-b2db-23c7f1b497b2 tempest-AttachVolumeNegativeTest-901206521 None] Created volume successfully. Jul 08 18:47:33 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83" returned: 0 in 0.903s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:33 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83 Jul 08 18:47:33 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:34 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e796ba18-77ba-40ed-85ef-6ffb0376ae83" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-e796ba18-77ba-40ed-85ef-6ffb0376ae83" released by "delete_volume" :: held 1.788s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Created reservations ['9c9ff707-8cda-4afd-995f-4486bd309ec9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:34 devstack cinder-volume[87229]: WARNING cinder.quota [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2098238818 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2098238818, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:47:34 devstack cinder-volume[87229]: WARNING cinder.quota [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2098238818 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2098238818, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:47:34 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d 1073741824" returned: 0 in 1.116s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Created reservations ['7b90c505-98e8-4a73-a7e4-c8e6f417a2c5', 'c9d85c74-54a9-4737-adc3-d06935d3e257', '7b04ef9a-bfaa-42e6-82a8-5881e53401c2', 'a9e51c0b-d7af-4f9c-9b9f-645ac8f4333a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:34 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d Jul 08 18:47:34 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:35 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:35 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Acquiring lock "cinder-quobyte-0418ca96-4e48-441e-b429-1865761adc7a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-0418ca96-4e48-441e-b429-1865761adc7a" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3391584-e9ea-413f-9a7a-24f036c2b330]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:35 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d" returned: 0 in 0.884s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4be410-eae1-4356-a83c-1f694b6b8111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db01ab89-2b64-4012-8ca1-398798733d6d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ee8f6-cb99-4668-98ec-4ec19d376d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Volume volume-db01ab89-2b64-4012-8ca1-398798733d6d (db01ab89-2b64-4012-8ca1-398798733d6d): created successfully Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ee8f6-cb99-4668-98ec-4ec19d376d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Flow 'volume_create_manager' (872e880a-eb9e-491c-95f3-70128181b626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3d037099-396d-4b44-8764-0a93d24c6881 tempest-AbsoluteLimitsTests-1972290044 None] Created volume successfully. Jul 08 18:47:35 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:35 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:35 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:35 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c7cb6476-56f3-40e4-b34e-8c9ea527da09 tempest-GroupsV314Test-1702633851 None] Delete group completed successfully. Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Acquiring lock "cinder-db01ab89-2b64-4012-8ca1-398798733d6d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "cinder-db01ab89-2b64-4012-8ca1-398798733d6d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Acquiring lock "cinder-quobyte-db01ab89-2b64-4012-8ca1-398798733d6d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "cinder-quobyte-db01ab89-2b64-4012-8ca1-398798733d6d" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2396c2-8043-431e-b34a-b1d4f9ec7633]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:36 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d Jul 08 18:47:36 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:36 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.870s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:36 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a Jul 08 18:47:36 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d" returned: 0 in 0.841s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:37 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d Jul 08 18:47:37 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0418ca96-4e48-441e-b429-1865761adc7a" returned: 0 in 0.704s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Lock "cinder-quobyte-0418ca96-4e48-441e-b429-1865761adc7a" released by "delete_volume" :: held 1.687s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Created reservations ['e6848be6-4e4e-4417-9aa6-cadd2c35c217'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Created reservations ['50337d33-6040-4748-a9a4-7c22e726d89f', 'ccd3e0de-5fa7-4aa0-85c1-8af54b79db9c', '0c387454-4625-4ef1-842a-7a3dc13cf2d5', 'be0fce0d-e94a-402d-83d2-6a5fe6b068a8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:37 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:37 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:37 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db01ab89-2b64-4012-8ca1-398798733d6d" returned: 0 in 0.709s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "cinder-quobyte-db01ab89-2b64-4012-8ca1-398798733d6d" released by "delete_volume" :: held 1.593s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:37 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Created reservations ['806d892a-6b63-4551-abfe-aea8c5aa1898', '72558bc5-a80f-4c1e-80e4-dfa99e8c894c', '2b93244f-adaa-40be-96ca-b7708900fe76', '875a44e7-17e3-4a92-97e6-d93c659fccc6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:38 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:38 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37871e02-b3e7-44e7-96da-f2c989103674]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:38 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.719s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-364c48e8-92c9-432d-8118-e2bd8b724846 tempest-GroupsV314Test-1702633851 None] Delete group completed successfully. Jul 08 18:47:38 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a Jul 08 18:47:38 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:38 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.888s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Deleted volume successfully. Jul 08 18:47:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f7311a6-6a62-4ebc-ae9c-54706d5c844f tempest-AbsoluteLimitsTests-1972290044 None] Lock "cinder-db01ab89-2b64-4012-8ca1-398798733d6d-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:39 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" returned: 0 in 0.961s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.996s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b7f21f2-665b-4a4d-b134-7fc4f0141e98', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:47:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-d202c5c3-2931-4748-96b8-0a7265cf1c2b req-cb55b69d-6936-4c75-aa06-29ea75075908 tempest-AttachVolumeNegativeTest-901206521 None] attachment_update completed successfully. Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=88,cinder:INSERT=27,cinder:UPDATE=84,cinder:DELETE=3 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c5e7217c-0614-400a-a11d-05bfa9c622ff tempest-GroupsV320Test-527202924 None] Group tempest-GroupsV320Test-Group-682120760: creating Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=86,cinder:INSERT=26,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Flow 'volume_create_manager' (cfa6ff60-3fca-4043-a733-633abedb679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a254a1c-ba0d-4e7a-8d59-f45f52950999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a254a1c-ba0d-4e7a-8d59-f45f52950999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-324095865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6c4321-dc0b-4c6a-a792-fd619727d9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745a2b69d1348469678cae8c3dd463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:46Z,use_quota=True,user_id='1baf6f099c804f6ea296e7e412034a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc824d1-5656-4140-b9c3-2a3acc7ef43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc824d1-5656-4140-b9c3-2a3acc7ef43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519d8856-a038-481d-9884-e0af51605071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519d8856-a038-481d-9884-e0af51605071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6c4321-dc0b-4c6a-a792-fd619727d9af', 'volume_name': 'volume-df6c4321-dc0b-4c6a-a792-fd619727d9af', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de5c66-9069-492e-849c-819dc69fefec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de5c66-9069-492e-849c-819dc69fefec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f626e876-536e-4575-b8a7-f9846adfec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Volume df6c4321-dc0b-4c6a-a792-fd619727d9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6c4321-dc0b-4c6a-a792-fd619727d9af', 'volume_size': 1} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-324095865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6c4321-dc0b-4c6a-a792-fd619727d9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745a2b69d1348469678cae8c3dd463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:46Z,use_quota=True,user_id='1baf6f099c804f6ea296e7e412034a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Creating volume df6c4321-dc0b-4c6a-a792-fd619727d9af {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c5e7217c-0614-400a-a11d-05bfa9c622ff tempest-GroupsV320Test-527202924 None] Group tempest-GroupsV320Test-Group-682120760: created successfully Jul 08 18:47:46 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af 1073741824 Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c5e7217c-0614-400a-a11d-05bfa9c622ff tempest-GroupsV320Test-527202924 None] Create group completed successfully. Jul 08 18:47:46 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-f8966b6d-c1bc-4f2b-ae4a-b48ea3c566a5 req-80f152a0-07f3-4047-be00-7419308cc3d6 tempest-AttachVolumeNegativeTest-901206521 None] Terminate volume connection completed successfully. Jul 08 18:47:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-f8966b6d-c1bc-4f2b-ae4a-b48ea3c566a5 req-80f152a0-07f3-4047-be00-7419308cc3d6 tempest-AttachVolumeNegativeTest-901206521 None] Deleting attachment 3b7f21f2-665b-4a4d-b134-7fc4f0141e98. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:47:47 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af 1073741824" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:47 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af Jul 08 18:47:47 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Created reservations ['c28af032-417e-408f-b23f-079718b27125'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:47 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:47 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:48 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f626e876-536e-4575-b8a7-f9846adfec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6c4321-dc0b-4c6a-a792-fd619727d9af', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf31d17e-974d-49af-9673-969e9e368cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Volume volume-df6c4321-dc0b-4c6a-a792-fd619727d9af (df6c4321-dc0b-4c6a-a792-fd619727d9af): created successfully Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf31d17e-974d-49af-9673-969e9e368cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Flow 'volume_create_manager' (cfa6ff60-3fca-4043-a733-633abedb679b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1d2f36f2-2296-4b0c-af20-f6dc816f7ff0 tempest-VolumesTransfersTest-885818505 None] Created volume successfully. Jul 08 18:47:48 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.831s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:48 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ea8182f5-e560-42db-b5ed-822a71fd3f57 tempest-GroupsV320Test-527202924 None] Delete group completed successfully. Jul 08 18:47:50 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4a7a479a-f03a-41f0-ab96-3b02e4fa9f8b tempest-VolumesTransfersTest-599040582 None] Transfer volume completed successfully. Jul 08 18:47:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "cinder-df6c4321-dc0b-4c6a-a792-fd619727d9af-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-df6c4321-dc0b-4c6a-a792-fd619727d9af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "cinder-quobyte-df6c4321-dc0b-4c6a-a792-fd619727d9af" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-quobyte-df6c4321-dc0b-4c6a-a792-fd619727d9af" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b0d4a-3b74-4554-a9c3-6f0f9ad89d62]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:52 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af Jul 08 18:47:52 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:53 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af" returned: 0 in 1.110s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:53 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af Jul 08 18:47:53 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:54 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-df6c4321-dc0b-4c6a-a792-fd619727d9af" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-quobyte-df6c4321-dc0b-4c6a-a792-fd619727d9af" released by "delete_volume" :: held 2.051s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Created reservations ['03df5cc1-e585-4974-aa81-35b316a8922d', 'ec2f4c40-c62a-441b-8c9e-85936c34dfed', '67a8a8ee-08e2-47aa-b81a-ca5cbf6e48b6', '2e43a4f7-eae7-4adc-adcd-b50cb85a753e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:54 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:47:54 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:55 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:55 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:47:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Deleted volume successfully. Jul 08 18:47:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-db74060e-4dc9-4079-a681-ef4a65f06a05 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-df6c4321-dc0b-4c6a-a792-fd619727d9af-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:47:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Flow 'volume_create_manager' (79c2af66-8cfd-42d2-9de3-985058a4145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeafecd-ca02-4de9-958d-4ed4dbced6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeafecd-ca02-4de9-958d-4ed4dbced6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946379100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6061726-bd47-4a62-b774-442587ba9519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745a2b69d1348469678cae8c3dd463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:56Z,use_quota=True,user_id='1baf6f099c804f6ea296e7e412034a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c880741-98cd-4e17-a522-7bc1f15c5fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c880741-98cd-4e17-a522-7bc1f15c5fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a53261-a1b3-4219-9030-b742aed15845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a53261-a1b3-4219-9030-b742aed15845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6061726-bd47-4a62-b774-442587ba9519', 'volume_name': 'volume-e6061726-bd47-4a62-b774-442587ba9519', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de15ad0-33e3-4dff-a570-8fe946bd9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de15ad0-33e3-4dff-a570-8fe946bd9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ff7491-e65f-46e2-a3e3-11d7cd1c25f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:56 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Volume e6061726-bd47-4a62-b774-442587ba9519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6061726-bd47-4a62-b774-442587ba9519', 'volume_size': 1} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946379100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6061726-bd47-4a62-b774-442587ba9519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f745a2b69d1348469678cae8c3dd463c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:47:56Z,use_quota=True,user_id='1baf6f099c804f6ea296e7e412034a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Creating volume e6061726-bd47-4a62-b774-442587ba9519 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:47:56 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:47:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:56 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 1073741824 Jul 08 18:47:56 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:57 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 1073741824" returned: 0 in 0.978s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:57 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 Jul 08 18:47:57 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:47:57 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519" returned: 0 in 0.763s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ff7491-e65f-46e2-a3e3-11d7cd1c25f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6061726-bd47-4a62-b774-442587ba9519', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914227e-7226-4479-9ec1-1740d2dea360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:47:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Volume volume-e6061726-bd47-4a62-b774-442587ba9519 (e6061726-bd47-4a62-b774-442587ba9519): created successfully Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914227e-7226-4479-9ec1-1740d2dea360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:47:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Flow 'volume_create_manager' (79c2af66-8cfd-42d2-9de3-985058a4145e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:47:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6e77df7a-b084-4158-82ee-aced8c4e35a5 tempest-VolumesTransfersTest-885818505 None] Created volume successfully. Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "cinder-e6061726-bd47-4a62-b774-442587ba9519-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-e6061726-bd47-4a62-b774-442587ba9519-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "cinder-quobyte-e6061726-bd47-4a62-b774-442587ba9519" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-quobyte-e6061726-bd47-4a62-b774-442587ba9519" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bb0271-1122-4500-ad1a-92c20f21332d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:47:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:47:59 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 Jul 08 18:47:59 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:00 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519" returned: 0 in 0.999s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:00 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519 Jul 08 18:48:00 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:01 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e6061726-bd47-4a62-b774-442587ba9519" returned: 0 in 0.891s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-quobyte-e6061726-bd47-4a62-b774-442587ba9519" released by "delete_volume" :: held 1.958s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Created reservations ['d2fabfad-b6a7-447c-ae82-45000673c7f4', 'a0de06f4-fd4b-4356-8ff1-71554287856e', 'a9848e50-8385-441c-a869-3bd355632f53', '64a204c4-17fa-4305-a143-0b98e1aa6415'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:01 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:01 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:02 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:02 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:02 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Deleted volume successfully. Jul 08 18:48:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6be152c-8376-4ddd-84e7-484566eeacb7 tempest-VolumesTransfersTest-2146520210 None] Lock "cinder-e6061726-bd47-4a62-b774-442587ba9519-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:11 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Flow 'volume_create_manager' (3c40134e-b7bf-4b62-b943-3fef6f408da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bc71e7-7e18-40a3-abee-9aa6d28c9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bc71e7-7e18-40a3-abee-9aa6d28c9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-852709879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abbf9ee-fa57-47ec-ade2-5bbab385bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e620e95dc49a2b1b62443ed97917e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:12Z,use_quota=True,user_id='a065d1eb17d64d2db963f9440d9a2edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec33de7-6fab-4149-a9eb-6cf199e433a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec33de7-6fab-4149-a9eb-6cf199e433a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9776edb-268e-4466-8002-9efff5bdadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9776edb-268e-4466-8002-9efff5bdadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abbf9ee-fa57-47ec-ade2-5bbab385bbcd', 'volume_name': 'volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ec3c-e0b2-4e3a-a547-5045426283e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ec3c-e0b2-4e3a-a547-5045426283e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ddeddc-ef2e-48cf-b099-5a25a8a2e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Volume 4abbf9ee-fa57-47ec-ade2-5bbab385bbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd', 'volume_size': 1} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-852709879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abbf9ee-fa57-47ec-ade2-5bbab385bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e620e95dc49a2b1b62443ed97917e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:12Z,use_quota=True,user_id='a065d1eb17d64d2db963f9440d9a2edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Creating volume 4abbf9ee-fa57-47ec-ade2-5bbab385bbcd {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:12 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:12 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd 1073741824 Jul 08 18:48:12 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:12 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=18,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:48:13 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd 1073741824" returned: 0 in 1.220s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:13 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd Jul 08 18:48:13 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:14 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ddeddc-ef2e-48cf-b099-5a25a8a2e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1362eb17-a723-48ed-a5ed-fd8de36180ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Volume volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd (4abbf9ee-fa57-47ec-ade2-5bbab385bbcd): created successfully Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1362eb17-a723-48ed-a5ed-fd8de36180ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Flow 'volume_create_manager' (3c40134e-b7bf-4b62-b943-3fef6f408da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-93488fa6-4d5d-4b30-b21b-b93e93e0a75a tempest-VolumesTransfersV357Test-557922647 None] Created volume successfully. Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Flow 'volume_create_manager' (ee61c9a3-7e4c-4175-90b0-e6b5b4a07a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b47862-3787-443b-a4ce-3861f39407cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b47862-3787-443b-a4ce-3861f39407cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-515679719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1382d1ed-a9f3-45bf-9152-c7b96b7ac13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c191ec3741a846e39245221df92134ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:14Z,use_quota=True,user_id='0d1ee8cbf456412dbb2394906f99141e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc639a1-57d3-4d34-b58c-e963d159ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc639a1-57d3-4d34-b58c-e963d159ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dbeff5-8365-415e-8b01-98f329f4c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dbeff5-8365-415e-8b01-98f329f4c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1382d1ed-a9f3-45bf-9152-c7b96b7ac13d', 'volume_name': 'volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48d75e8-4cd9-4fb8-918e-cf72e49c58e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48d75e8-4cd9-4fb8-918e-cf72e49c58e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dfae4e-c4fa-4cb9-bdd1-61460413c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume 1382d1ed-a9f3-45bf-9152-c7b96b7ac13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d', 'volume_size': 1} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-515679719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1382d1ed-a9f3-45bf-9152-c7b96b7ac13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c191ec3741a846e39245221df92134ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:14Z,use_quota=True,user_id='0d1ee8cbf456412dbb2394906f99141e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Creating volume 1382d1ed-a9f3-45bf-9152-c7b96b7ac13d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:14 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:14 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d 1073741824 Jul 08 18:48:14 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:15 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d 1073741824" returned: 0 in 1.063s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:15 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d Jul 08 18:48:15 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f3b06222-f066-4b61-8c17-790e2107e044 tempest-VolumesTransfersV357Test-1538017342 None] Transfer volume completed successfully. Jul 08 18:48:16 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" returned: 0 in 1.094s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dfae4e-c4fa-4cb9-bdd1-61460413c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2399921-2636-4d57-aee6-c6b3b17b03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:16 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d (1382d1ed-a9f3-45bf-9152-c7b96b7ac13d): created successfully Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2399921-2636-4d57-aee6-c6b3b17b03aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Flow 'volume_create_manager' (ee61c9a3-7e4c-4175-90b0-e6b5b4a07a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e1cca376-46a9-42e1-8ad1-da415d843e4e tempest-VolumeQuotasAdminTestJSON-1752991563 None] Created volume successfully. Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "cinder-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "cinder-quobyte-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-quobyte-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" acquired by "delete_volume" :: waited 0.051s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec46476-0ad4-45bb-bb71-8ceee4b6cc90]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "cinder-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "cinder-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "cinder-quobyte-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "cinder-quobyte-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:18 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd Jul 08 18:48:18 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80173a-094a-4da9-b34f-46cb7ec85f94]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:18 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:18 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:18 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d Jul 08 18:48:18 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:19 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" returned: 0 in 1.147s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:19 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd Jul 08 18:48:19 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:19 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.545s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:48:19 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" returned: 0 in 1.700s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:19 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d Jul 08 18:48:19 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:20 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" returned: 0 in 1.200s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-quobyte-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd" released by "delete_volume" :: held 2.425s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Created reservations ['14f814a4-bee3-41b0-b1f6-e575e090f79d', 'c6601348-07c1-4ded-b24c-16e325fbd288', '9f9eb547-8070-425d-90a3-9bacc6f61ba3', '4e3973e3-2cb4-4145-84c8-ac73bed10682'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:20 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:20 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:20 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" returned: 0 in 1.049s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "cinder-quobyte-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d" released by "delete_volume" :: held 2.829s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Created reservations ['959b6183-387f-4876-935d-22ada2f96e37', '58369490-d4c2-49fe-bda1-d4d85326944a', '35e74aea-2247-4199-95ee-8257c097131d', 'e556b99e-7923-4037-b556-86b6a3d780f2'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:21 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:21 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:21 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.007s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Deleted volume successfully. Jul 08 18:48:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c755b7ff-42aa-4a24-8077-c0e1e3e08e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-4abbf9ee-fa57-47ec-ade2-5bbab385bbcd-delete_volume" released by "delete_volume" :: held 4.070s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Flow 'volume_create_manager' (948b14ef-6c4b-4cac-9186-32ee2cdd1c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a373131-fb31-482a-b291-5c5b5d416cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a373131-fb31-482a-b291-5c5b5d416cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914959041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fda419-fb6e-4e3f-8d97-a41e08e013d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e620e95dc49a2b1b62443ed97917e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:22Z,use_quota=True,user_id='a065d1eb17d64d2db963f9440d9a2edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c35311-6d0a-4687-9d3e-e32046664435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c35311-6d0a-4687-9d3e-e32046664435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8a2365-d377-4e12-9598-d1fc33cd6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8a2365-d377-4e12-9598-d1fc33cd6b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fda419-fb6e-4e3f-8d97-a41e08e013d6', 'volume_name': 'volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb564a99-ec43-4545-b004-5512af85ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb564a99-ec43-4545-b004-5512af85ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1920ec1d-9a91-40f3-85a5-7042aaecf57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Volume 99fda419-fb6e-4e3f-8d97-a41e08e013d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6', 'volume_size': 1} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914959041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fda419-fb6e-4e3f-8d97-a41e08e013d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e620e95dc49a2b1b62443ed97917e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:22Z,use_quota=True,user_id='a065d1eb17d64d2db963f9440d9a2edf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Creating volume 99fda419-fb6e-4e3f-8d97-a41e08e013d6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:22 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.294s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Deleted volume successfully. Jul 08 18:48:22 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 1073741824 Jul 08 18:48:22 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d02c5235-1230-478d-815b-a8a2212f74fb tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "cinder-1382d1ed-a9f3-45bf-9152-c7b96b7ac13d-delete_volume" released by "delete_volume" :: held 4.470s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Flow 'volume_create_manager' (eeb96f5e-ed4c-49cc-a176-5398d6eba038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950fb529-e77d-499a-981b-2e21c36a200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950fb529-e77d-499a-981b-2e21c36a200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-234264891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55a0959-6ef9-4488-adcf-4385157af029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c191ec3741a846e39245221df92134ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:23Z,use_quota=True,user_id='0d1ee8cbf456412dbb2394906f99141e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541e0538-4e59-4536-84f9-7807733f1021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541e0538-4e59-4536-84f9-7807733f1021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be14fad5-49db-4b34-9377-117574344679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be14fad5-49db-4b34-9377-117574344679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55a0959-6ef9-4488-adcf-4385157af029', 'volume_name': 'volume-d55a0959-6ef9-4488-adcf-4385157af029', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541d816c-dc9a-4814-9118-c22d2245bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541d816c-dc9a-4814-9118-c22d2245bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b9795-8cb5-4d5d-ac1b-1c23e2b166e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume d55a0959-6ef9-4488-adcf-4385157af029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55a0959-6ef9-4488-adcf-4385157af029', 'volume_size': 1} Jul 08 18:48:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:23 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 1073741824" returned: 0 in 1.120s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:23 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 Jul 08 18:48:23 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:24 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-234264891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55a0959-6ef9-4488-adcf-4385157af029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c191ec3741a846e39245221df92134ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:23Z,use_quota=True,user_id='0d1ee8cbf456412dbb2394906f99141e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Creating volume d55a0959-6ef9-4488-adcf-4385157af029 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:24 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1920ec1d-9a91-40f3-85a5-7042aaecf57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 1073741824 Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787630fb-9d3c-4636-9891-be5abd95e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:24 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Volume volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 (99fda419-fb6e-4e3f-8d97-a41e08e013d6): created successfully Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787630fb-9d3c-4636-9891-be5abd95e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Flow 'volume_create_manager' (948b14ef-6c4b-4cac-9186-32ee2cdd1c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ed42394f-4463-4733-99b4-84ef12f83028 tempest-VolumesTransfersV357Test-557922647 None] Created volume successfully. Jul 08 18:48:25 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 1073741824" returned: 0 in 0.933s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Acquiring lock "cinder-21b7ea00-e9f2-403e-bf56-6f6e700072c4-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "cinder-21b7ea00-e9f2-403e-bf56-6f6e700072c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:25 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 Jul 08 18:48:25 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Acquiring lock "cinder-quobyte-21b7ea00-e9f2-403e-bf56-6f6e700072c4" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "cinder-quobyte-21b7ea00-e9f2-403e-bf56-6f6e700072c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f99e52-06c1-4c15-90b7-fc6830078655]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:25 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 Jul 08 18:48:25 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "cinder-99fda419-fb6e-4e3f-8d97-a41e08e013d6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-99fda419-fb6e-4e3f-8d97-a41e08e013d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "cinder-quobyte-99fda419-fb6e-4e3f-8d97-a41e08e013d6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-quobyte-99fda419-fb6e-4e3f-8d97-a41e08e013d6" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce6c6f-7763-4574-9ae2-0eb44e323edf]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:26 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 Jul 08 18:48:26 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:26 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029" returned: 0 in 0.957s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b9795-8cb5-4d5d-ac1b-1c23e2b166e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55a0959-6ef9-4488-adcf-4385157af029', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbdb919-e338-401c-9a9b-f6e8c8887aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:26 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Volume volume-d55a0959-6ef9-4488-adcf-4385157af029 (d55a0959-6ef9-4488-adcf-4385157af029): created successfully Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbdb919-e338-401c-9a9b-f6e8c8887aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Flow 'volume_create_manager' (eeb96f5e-ed4c-49cc-a176-5398d6eba038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:26 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7f4a4705-e21d-421d-8de7-653bce0eb0a4 tempest-VolumeQuotasAdminTestJSON-1752991563 None] Created volume successfully. Jul 08 18:48:26 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4" returned: 0 in 1.079s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:26 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4 Jul 08 18:48:26 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:26 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6" returned: 0 in 0.877s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:26 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6 Jul 08 18:48:26 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:27 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-21b7ea00-e9f2-403e-bf56-6f6e700072c4" returned: 0 in 0.816s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "cinder-quobyte-21b7ea00-e9f2-403e-bf56-6f6e700072c4" released by "delete_volume" :: held 1.954s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Created reservations ['035ebac7-0a32-4642-b037-91c8cd536fa7', '01d86eb0-9550-46e2-a112-e031d75c7369', '4016186d-cfba-412b-ada0-2891f979247a', 'de752971-4666-4fa2-9328-8661c70540de'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:27 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:27 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:27 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-99fda419-fb6e-4e3f-8d97-a41e08e013d6" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-quobyte-99fda419-fb6e-4e3f-8d97-a41e08e013d6" released by "delete_volume" :: held 1.771s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Created reservations ['0bb0a257-ad55-4306-94bd-135c4c401f1c', 'c8492c09-ec62-416d-af3c-57364986e00c', 'b6e21cd4-1b12-4851-a321-33ee5efdf3f8', 'e56453d6-783d-42d8-8f61-9e3c311cfe98'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e41b7e65-a97c-4290-98fb-add8fe7d1c72 tempest-VolumeQuotasAdminTestJSON-1696971339 None] Transfer volume completed successfully. Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:28 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:28 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:28 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.175s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Deleted volume successfully. Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c01e6563-b7d2-4b94-8155-6a26f416074d tempest-AttachVolumeShelveTestJSON-272907787 None] Lock "cinder-21b7ea00-e9f2-403e-bf56-6f6e700072c4-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:28 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.938s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Deleted volume successfully. Jul 08 18:48:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0720cbb7-15bc-476a-8c0a-aff7ab818e4c tempest-VolumesTransfersV357Test-1883358756 None] Lock "cinder-99fda419-fb6e-4e3f-8d97-a41e08e013d6-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Acquiring lock "cinder-d55a0959-6ef9-4488-adcf-4385157af029-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "cinder-d55a0959-6ef9-4488-adcf-4385157af029-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Acquiring lock "cinder-quobyte-d55a0959-6ef9-4488-adcf-4385157af029" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "cinder-quobyte-d55a0959-6ef9-4488-adcf-4385157af029" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e87e6b-ba3b-48bc-9ac1-e0da5f3c9bd0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:29 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 Jul 08 18:48:29 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:30 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029" returned: 0 in 0.868s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:30 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029 Jul 08 18:48:30 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:30 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d55a0959-6ef9-4488-adcf-4385157af029" returned: 0 in 0.799s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "cinder-quobyte-d55a0959-6ef9-4488-adcf-4385157af029" released by "delete_volume" :: held 1.729s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:30 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Created reservations ['a9a95ae8-5f28-473a-ba03-2d1f4820c635', '4a6a4692-1849-40a9-9f4e-6f2024b73ab0', 'f5eb223d-8980-4f30-9edd-0ac7f7e5b5ea', '002f84c6-99d2-4469-a711-c88392affac9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:31 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:31 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:31 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Deleted volume successfully. Jul 08 18:48:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d95cc892-8045-4623-aba2-b74c69caa358 tempest-VolumeQuotasAdminTestJSON-1961371615 None] Lock "cinder-d55a0959-6ef9-4488-adcf-4385157af029-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (26d13537-2fdc-4ce2-a1ae-a1663f341cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54c0db-ca40-4da5-980c-0ab470fe7f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Flow 'volume_create_manager' (a23bc9a7-36ff-468f-a96f-87bd597730dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8f468-f42b-4bad-ad5f-5ea18889d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54c0db-ca40-4da5-980c-0ab470fe7f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103674254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3794c720-579a-4996-99e5-39956184fd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af63866e-63ae-4d38-ae9c-df1d79f4e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af63866e-63ae-4d38-ae9c-df1d79f4e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b645e-27de-426b-a5db-1a1e41760d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b645e-27de-426b-a5db-1a1e41760d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3794c720-579a-4996-99e5-39956184fd67', 'volume_name': 'volume-3794c720-579a-4996-99e5-39956184fd67', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30733c-aed5-4d88-8fe2-8e320c4f9b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30733c-aed5-4d88-8fe2-8e320c4f9b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca20fab-05c1-43cf-9000-8ccaf26c5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Volume 3794c720-579a-4996-99e5-39956184fd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3794c720-579a-4996-99e5-39956184fd67', 'volume_size': 1} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-103674254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3794c720-579a-4996-99e5-39956184fd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d7403e5baa49c4a127bf277a4d8e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='0b4474f7ce1740138b5acf4dcc2dfeac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Creating volume 3794c720-579a-4996-99e5-39956184fd67 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:41 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8f468-f42b-4bad-ad5f-5ea18889d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1393058613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2a544e-b22c-4f53-98c2-d37874dcc706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a652552e14b7419b9e828a28d236d5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='9f6eb41553b74b7ea1ca801a17e173e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134f381b-fed2-4320-aff7-fc07c6e22214),volume_type_id=134f381b-fed2-4320-aff7-fc07c6e22214)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a81668-891d-4a2b-a4e9-802689919bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a81668-891d-4a2b-a4e9-802689919bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13426d7-a845-407d-a2fd-ae9190a2aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13426d7-a845-407d-a2fd-ae9190a2aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2a544e-b22c-4f53-98c2-d37874dcc706', 'volume_name': 'volume-bb2a544e-b22c-4f53-98c2-d37874dcc706', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 1073741824 Jul 08 18:48:42 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9539da-4aa1-4c5c-93a2-2d52254abc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9539da-4aa1-4c5c-93a2-2d52254abc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf667c24-ef99-468d-a82b-eb9ef8d18bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:42 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Volume bb2a544e-b22c-4f53-98c2-d37874dcc706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2a544e-b22c-4f53-98c2-d37874dcc706', 'volume_size': 1} Jul 08 18:48:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:43 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 1073741824" returned: 0 in 1.136s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:43 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 Jul 08 18:48:43 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:43 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67" returned: 0 in 0.815s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1393058613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2a544e-b22c-4f53-98c2-d37874dcc706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a652552e14b7419b9e828a28d236d5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:42Z,use_quota=True,user_id='9f6eb41553b74b7ea1ca801a17e173e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134f381b-fed2-4320-aff7-fc07c6e22214),volume_type_id=134f381b-fed2-4320-aff7-fc07c6e22214)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Creating volume bb2a544e-b22c-4f53-98c2-d37874dcc706 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:44 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca20fab-05c1-43cf-9000-8ccaf26c5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3794c720-579a-4996-99e5-39956184fd67', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:44 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 1073741824 Jul 08 18:48:44 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33bd0bc-f4aa-470d-ab69-6f398cea7eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:44 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Volume volume-3794c720-579a-4996-99e5-39956184fd67 (3794c720-579a-4996-99e5-39956184fd67): created successfully Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33bd0bc-f4aa-470d-ab69-6f398cea7eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Flow 'volume_create_manager' (26d13537-2fdc-4ce2-a1ae-a1663f341cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-377ff518-7010-4cc6-8abc-8c2831cc033b tempest-AttachVolumeNegativeTest-901206521 None] Created volume successfully. Jul 08 18:48:45 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 1073741824" returned: 0 in 1.067s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:45 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 Jul 08 18:48:45 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:45 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706" returned: 0 in 0.853s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf667c24-ef99-468d-a82b-eb9ef8d18bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2a544e-b22c-4f53-98c2-d37874dcc706', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556cd65-270e-4fd4-a41b-1b77503abd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:46 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Volume volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 (bb2a544e-b22c-4f53-98c2-d37874dcc706): created successfully Jul 08 18:48:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556cd65-270e-4fd4-a41b-1b77503abd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Flow 'volume_create_manager' (a23bc9a7-36ff-468f-a96f-87bd597730dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0e02fb21-a2a7-4bf9-9bfb-719873e133c4 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Created volume successfully. Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:47 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:47 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f020c-3f6f-4de3-93d8-416b3175353b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:48 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.804s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:48 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7556dbd8-6ea6-4413-a9d5-b49ce089a5e2 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Retype volume completed successfully. Jul 08 18:48:48 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 Jul 08 18:48:48 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "cinder-bb2a544e-b22c-4f53-98c2-d37874dcc706-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "cinder-bb2a544e-b22c-4f53-98c2-d37874dcc706-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "cinder-quobyte-bb2a544e-b22c-4f53-98c2-d37874dcc706" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "cinder-quobyte-bb2a544e-b22c-4f53-98c2-d37874dcc706" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb29e60-d28c-41e1-8eee-05aa79ff492d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:49 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 Jul 08 18:48:49 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:49 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67" returned: 0 in 1.150s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.174s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-3794c720-579a-4996-99e5-39956184fd67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4facc1d4-0c5f-4707-b12f-28b12e596510', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:48:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-98cf54b9-42f2-4ff6-a2de-6b591a069f26 req-5601fdf8-36f1-4588-b347-436a0ee7e4a9 tempest-AttachVolumeNegativeTest-901206521 None] attachment_update completed successfully. Jul 08 18:48:49 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (1e164078-86fa-49c9-bfab-67b0ceabaec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7db0672-7430-439f-9340-38a502525170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7db0672-7430-439f-9340-38a502525170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1017973579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37746bf-e083-4954-854a-2934bb8872b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:50Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7281e57e-ff17-4274-8787-f98acb8d1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7281e57e-ff17-4274-8787-f98acb8d1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832fe738-1d05-434e-815c-dc6796b05eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832fe738-1d05-434e-815c-dc6796b05eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37746bf-e083-4954-854a-2934bb8872b2', 'volume_name': 'volume-f37746bf-e083-4954-854a-2934bb8872b2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefa15b5-a833-458a-8143-388bf2d86ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefa15b5-a833-458a-8143-388bf2d86ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603268a4-306f-4750-a9d4-e89e163cc43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:50 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Volume f37746bf-e083-4954-854a-2934bb8872b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37746bf-e083-4954-854a-2934bb8872b2', 'volume_size': 1} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1017973579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37746bf-e083-4954-854a-2934bb8872b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:50Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Creating volume f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:50 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:50 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706" returned: 0 in 0.955s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:50 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 1073741824 Jul 08 18:48:50 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:50 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706 Jul 08 18:48:50 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:50 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bb2a544e-b22c-4f53-98c2-d37874dcc706" returned: 0 in 0.806s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "cinder-quobyte-bb2a544e-b22c-4f53-98c2-d37874dcc706" released by "delete_volume" :: held 1.812s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:51 devstack cinder-volume[87229]: WARNING cinder.quota [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:48:51 devstack cinder-volume[87229]: WARNING cinder.quota [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Created reservations ['5319fa4e-a78a-4e46-8db1-e3f4e85a3989', '6d5ae58e-caa1-453a-b607-442fa3bf0875', 'cb07c259-8c6e-4b55-9fed-7ec0d95bfb88', '2c3ad64a-6a1c-4cde-a143-749f00f18dda'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:51 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:48:51 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:51 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 1073741824" returned: 0 in 1.229s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:51 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 Jul 08 18:48:51 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:51 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.794s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:48:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Deleted volume successfully. Jul 08 18:48:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3fac2839-6adf-43f8-bb84-4332240918b7 tempest-VolumeRetypeWithoutMigrationTest-102113892 None] Lock "cinder-bb2a544e-b22c-4f53-98c2-d37874dcc706-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:48:52 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2" returned: 0 in 0.801s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603268a4-306f-4750-a9d4-e89e163cc43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37746bf-e083-4954-854a-2934bb8872b2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1304d644-fe44-49c2-8a8b-2f6ce0df6afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Volume volume-f37746bf-e083-4954-854a-2934bb8872b2 (f37746bf-e083-4954-854a-2934bb8872b2): created successfully Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1304d644-fe44-49c2-8a8b-2f6ce0df6afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (1e164078-86fa-49c9-bfab-67b0ceabaec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2eb8fb85-6a67-4053-b889-83b5b442f88a tempest-VolumesSnapshotTestJSON-603215442 None] Created volume successfully. Jul 08 18:48:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Creating offline snapshot b3c4f3f8-8210-4425-861d-a63fa2051a41 of volume f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:48:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee88703-8803-479d-b946-aac0754ae441]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:48:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:53 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 Jul 08 18:48:53 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:54 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2" returned: 0 in 1.043s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:54 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 1G Jul 08 18:48:54 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:55 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 1G" returned: 0 in 1.279s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37746bf-e083-4954-854a-2934bb8872b2 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:56 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37746bf-e083-4954-854a-2934bb8872b2 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 Jul 08 18:48:56 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-ae2d6195-d73e-4a7c-aa1b-21fe493e3746 req-c11d8334-b50b-4ab7-9fb2-e7a44da43859 tempest-AttachVolumeNegativeTest-901206521 None] Terminate volume connection completed successfully. Jul 08 18:48:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-ae2d6195-d73e-4a7c-aa1b-21fe493e3746 req-c11d8334-b50b-4ab7-9fb2-e7a44da43859 tempest-AttachVolumeNegativeTest-901206521 None] Deleting attachment 4facc1d4-0c5f-4707-b12f-28b12e596510. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:48:56 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37746bf-e083-4954-854a-2934bb8872b2 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41" returned: 0 in 0.936s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:56 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 is being set with open permissions: ugo+rw Jul 08 18:48:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:56 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 Jul 08 18:48:56 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:57 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41" returned: 0 in 0.741s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:57 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info Jul 08 18:48:57 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:57 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:48:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Flow 'volume_create_manager' (1b8b57dc-d4e9-45a1-b153-4e9121a65e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:48:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75170157-4ae9-4b3c-a899-eab52c18dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75170157-4ae9-4b3c-a899-eab52c18dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-165975102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fba7993-bfeb-4d2e-afcd-ca913e88c5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1446b5b4813447f296e6b2aa356e4cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:58Z,use_quota=True,user_id='6abe9f3ee5844d72994a9df7ae94bd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dcd9c4-ec82-4331-be3f-dc2bc6352b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dcd9c4-ec82-4331-be3f-dc2bc6352b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050d698a-ae08-44b8-9697-a151cd0f72f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050d698a-ae08-44b8-9697-a151cd0f72f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fba7993-bfeb-4d2e-afcd-ca913e88c5b4', 'volume_name': 'volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b8e15c-9603-425a-b517-3ee2163c587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b8e15c-9603-425a-b517-3ee2163c587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be165b2-fc9e-4872-a732-67542482d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:48:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Volume 1fba7993-bfeb-4d2e-afcd-ca913e88c5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4', 'volume_size': 1} Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:58 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info" returned: 0 in 0.738s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:58 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info is being set with open permissions: ugo+rw Jul 08 18:48:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:58 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info Jul 08 18:48:58 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:59 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.info" returned: 0 in 0.743s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.606s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-165975102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fba7993-bfeb-4d2e-afcd-ca913e88c5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1446b5b4813447f296e6b2aa356e4cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:48:58Z,use_quota=True,user_id='6abe9f3ee5844d72994a9df7ae94bd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Creating volume 1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:48:59 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:48:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:48:59 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 1073741824 Jul 08 18:48:59 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:48:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-92aed7a1-22bd-463e-87fe-2914d3b49c27 tempest-VolumesSnapshotTestJSON-603215442 None] Create snapshot completed successfully Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-b3c4f3f8-8210-4425-861d-a63fa2051a41-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-b3c4f3f8-8210-4425-861d-a63fa2051a41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-b3c4f3f8-8210-4425-861d-a63fa2051a41" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-b3c4f3f8-8210-4425-861d-a63fa2051a41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Deleting offline snapshot b3c4f3f8-8210-4425-861d-a63fa2051a41 of volume f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:49:00 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] snapshot_file for this snap is: volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 1073741824" returned: 0 in 0.970s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78eb47-d9f9-4caf-b9f0-da1357cfd291]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:00 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 Jul 08 18:49:00 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:00 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 Jul 08 18:49:00 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:01 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" returned: 0 in 0.904s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be165b2-fc9e-4872-a732-67542482d992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38277ed0-59ce-43c3-99e3-47c51fac6d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Volume volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 (1fba7993-bfeb-4d2e-afcd-ca913e88c5b4): created successfully Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38277ed0-59ce-43c3-99e3-47c51fac6d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Flow 'volume_create_manager' (1b8b57dc-d4e9-45a1-b153-4e9121a65e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d60f9738-1f61-4f30-98fa-b7ddb731d1fb tempest-VolumesServicesTestJSON-1137323100 None] Created volume successfully. Jul 08 18:49:01 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41" returned: 0 in 1.174s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f37746bf-e083-4954-854a-2934bb8872b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94085717-6b58-48d6-bc51-6298d0039bb2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:01 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 Jul 08 18:49:01 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:02 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2" returned: 0 in 1.056s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:02 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 Jul 08 18:49:02 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Acquiring lock "cinder-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "cinder-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Acquiring lock "cinder-quobyte-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "cinder-quobyte-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24a45a-c12b-47b4-81e5-eb8fd8c7426e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:02 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 Jul 08 18:49:02 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:03 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41" returned: 0 in 1.284s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:03 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41 Jul 08 18:49:03 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:03 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" returned: 0 in 1.156s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:03 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4 Jul 08 18:49:03 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:04 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2.b3c4f3f8-8210-4425-861d-a63fa2051a41" returned: 0 in 0.723s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-b3c4f3f8-8210-4425-861d-a63fa2051a41" released by "_delete_snapshot" :: held 4.381s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" released by "delete_snapshot" :: held 4.412s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['d128fbd7-1866-4278-ae21-b6c408e3f676', 'a1995a70-086b-4b1e-b4b7-78efec97c750', '7caf5752-dc8e-45f2-801a-be16a42bad84', 'e2370222-c13b-487a-a361-3cf8ad6ce5b5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:04 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "cinder-quobyte-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4" released by "delete_volume" :: held 1.988s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Delete snapshot completed successfully. Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-754abf76-ff8d-4a68-b9c6-2180fbc70e01 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-b3c4f3f8-8210-4425-861d-a63fa2051a41-delete_snapshot" released by "delete_snapshot" :: held 4.670s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Created reservations ['ff3f48ca-204d-4d09-a403-b1060be62cb6', '8d99d94c-58cb-48db-8102-e43c4df85ce6', '982cb041-d6c7-4273-814f-0aed21b8d012', '92da286a-2f04-4b6d-94f7-6349bc4f4fd7'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:04 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:04 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:05 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:05 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Deleted volume successfully. Jul 08 18:49:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e98da6fc-c692-4311-9d9e-2e9611287a85 tempest-VolumesServicesTestJSON-1137323100 None] Lock "cinder-1fba7993-bfeb-4d2e-afcd-ca913e88c5b4-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (005897b2-340a-436c-8c9b-1ff3dd6d5b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed8b61c-1571-4e62-8669-fe3dc52bab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed8b61c-1571-4e62-8669-fe3dc52bab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867267006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dba7386-3e9b-46d2-8bd3-369e47977b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:06Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4e693b-62cc-4534-958b-873232a139d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4e693b-62cc-4534-958b-873232a139d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8982a01d-3364-4c0e-880e-ea36c92ebeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8982a01d-3364-4c0e-880e-ea36c92ebeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dba7386-3e9b-46d2-8bd3-369e47977b8a', 'volume_name': 'volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae23e5-da9b-4aff-a956-192f19df7ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae23e5-da9b-4aff-a956-192f19df7ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ef6037-0181-416f-a17d-3d56fef5dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:06 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Volume 3dba7386-3e9b-46d2-8bd3-369e47977b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a', 'volume_size': 1} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867267006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dba7386-3e9b-46d2-8bd3-369e47977b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:06Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Creating volume 3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:06 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:06 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a 1073741824 Jul 08 18:49:06 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:07 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a 1073741824" returned: 0 in 1.168s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:07 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:07 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:08 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ef6037-0181-416f-a17d-3d56fef5dd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187516b-3892-4a2d-a9d1-7ab8c9d78be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Volume volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a (3dba7386-3e9b-46d2-8bd3-369e47977b8a): created successfully Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187516b-3892-4a2d-a9d1-7ab8c9d78be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (005897b2-340a-436c-8c9b-1ff3dd6d5b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5b4049e7-f77a-4392-b6fc-e2b95e0d7ec3 tempest-VolumesSnapshotTestJSON-603215442 None] Created volume successfully. Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-3794c720-579a-4996-99e5-39956184fd67-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-3794c720-579a-4996-99e5-39956184fd67-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-quobyte-3794c720-579a-4996-99e5-39956184fd67" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-3794c720-579a-4996-99e5-39956184fd67" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd14d11-0e3f-453c-8a73-7b4d207cd2f4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:08 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 Jul 08 18:49:08 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Creating offline snapshot 05fce39c-0d49-405a-985a-fc5b28e9e1f5 of volume 3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc01b4d-4ea9-40df-8706-ef99ddf53626]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:09 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67" returned: 0 in 1.231s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:10 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67 Jul 08 18:49:10 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:10 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:10 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:11 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 1.164s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:11 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3794c720-579a-4996-99e5-39956184fd67" returned: 0 in 1.123s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:11 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 1G Jul 08 18:49:11 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-3794c720-579a-4996-99e5-39956184fd67" released by "delete_volume" :: held 2.408s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Created reservations ['26d1882f-e97a-4721-b66a-9c2777dd8dd5', 'f6c97784-fd3e-4915-8a64-bb3633f0045c', '799294d8-9521-429c-8767-f13bca589d2b', 'fdb20889-8fe8-4eab-8088-844b1fe6bf8c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:11 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:11 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:12 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 1G" returned: 0 in 1.144s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:12 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:12 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:12 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.257s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Deleted volume successfully. Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=96,cinder:UPDATE=105,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4c35031b-6e3d-4d72-a3c9-4d0107f0294b tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-3794c720-579a-4996-99e5-39956184fd67-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-quobyte-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" acquired by "delete_volume" :: waited 0.047s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[077218d9-e434-468c-a74b-ea7f84a756ca]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:13 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a Jul 08 18:49:13 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:13 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 1.009s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:13 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 is being set with open permissions: ugo+rw Jul 08 18:49:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:13 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:13 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:14 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" returned: 0 in 1.410s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:14 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a Jul 08 18:49:14 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:14 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 1.231s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:14 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=85,cinder:INSERT=24,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:14 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info Jul 08 18:49:14 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:15 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" returned: 0 in 0.979s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a" released by "delete_volume" :: held 2.470s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Created reservations ['35628e55-1540-4106-b4b3-3186392896af', 'bb6929e9-5b37-40d6-8b5e-cf23ddf2ef79', '3a3b4941-a63f-4d6c-8aa8-ab1ab60b4995', '7894196f-9fa5-47b2-9c45-a502a5475920'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:15 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:15 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:15 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info" returned: 0 in 0.997s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:15 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info is being set with open permissions: ugo+rw Jul 08 18:49:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:15 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info Jul 08 18:49:15 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:16 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.info" returned: 0 in 1.131s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.850s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:16 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.336s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Deleted volume successfully. Jul 08 18:49:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-417166d1-2119-4c8b-bb09-ee0467dced34 tempest-VolumesSnapshotTestJSON-603215442 None] Create snapshot completed successfully Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2cc3882-360f-40ed-b797-e9eb6d225ded tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-4dcd97c0-e004-4fa4-a54c-ff387d2cc10a-delete_volume" released by "delete_volume" :: held 4.186s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "cinder-quobyte-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff981c-2d96-4d0d-98c5-7307d4a5ebac]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:17 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 Jul 08 18:49:17 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:17 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" returned: 0 in 1.007s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:18 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76 Jul 08 18:49:18 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:18 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:18 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (6a469eb0-262a-4035-bbdb-f44dfa2b96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97de30d-f96d-49bc-85a2-c7cab6d4c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97de30d-f96d-49bc-85a2-c7cab6d4c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-743499680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa4a4ab-64dc-441a-a2cc-6a9d41079af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=05fce39c-0d49-405a-985a-fc5b28e9e1f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:18Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ba6ca6-8e66-4f6e-87e9-b9b9116cb1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ba6ca6-8e66-4f6e-87e9-b9b9116cb1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c7026e-953c-43e2-aa98-ef6aa4bc3a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c7026e-953c-43e2-aa98-ef6aa4bc3a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fa4a4ab-64dc-441a-a2cc-6a9d41079af6', 'volume_name': 'volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6', 'volume_size': 2, 'snapshot_id': '05fce39c-0d49-405a-985a-fc5b28e9e1f5'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112d113-d3e5-470c-b9e8-0f23b108e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112d113-d3e5-470c-b9e8-0f23b108e016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c8ba0e-a6e8-4777-887a-fe0160c8d837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:18 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Volume 7fa4a4ab-64dc-441a-a2cc-6a9d41079af6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6', 'volume_size': 2, 'snapshot_id': '05fce39c-0d49-405a-985a-fc5b28e9e1f5'} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Creating volume 7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 from snapshot 05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] snapshot: 05fce39c-0d49-405a-985a-fc5b28e9e1f5, volume: 7fa4a4ab-64dc-441a-a2cc-6a9d41079af6, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5dac1e-8fc1-4ea3-b09b-1a72275bb2ac]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:18 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:18 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:18 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.804s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:49:19 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" returned: 0 in 1.126s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-quobyte-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76" released by "delete_volume" :: held 2.193s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Created reservations ['6fc2c208-aca5-44d4-87f8-56a84bc6f82d', '277c70cb-df6c-4c71-86d9-72ea8d9a7b6e', 'f615f00d-acb1-4fe3-bf16-438b3b0c4793', '2c405453-f68b-42f5-8d19-84ef24332466'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:19 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:19 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:19 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 1.178s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec398cb0-17fb-480c-8d33-5ab6189f7d66]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:19 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:19 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:20 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Deleted volume successfully. Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee9f5f65-2b4f-4fee-a6a9-a7d0e6efd2d1 tempest-AttachVolumeNegativeTest-901206521 None] Lock "cinder-59c8dfa8-5d7d-41e8-8fd2-165cbb5c0b76-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:20 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 1.085s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:49:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:20 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 Jul 08 18:49:20 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:27 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" returned: 0 in 6.449s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ad278-e029-4f92-99f1-f59d2194ad08]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:27 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:27 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:28 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 1.082s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:28 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:49:28 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Converted 1024.00 MB image at 158.75 MB/s Jul 08 18:49:28 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 is being set with open permissions: ugo+rw Jul 08 18:49:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:28 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 Jul 08 18:49:28 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:49:29 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" returned: 0 in 0.990s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" released by "_copy_volume_from_snapshot" :: held 10.915s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" released by "_create_volume_from_snapshot" :: held 10.961s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.988s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c8ba0e-a6e8-4777-887a-fe0160c8d837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6', 'volume_size': 2, 'snapshot_id': '05fce39c-0d49-405a-985a-fc5b28e9e1f5'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8136d2-b98f-4444-a3f4-383a5a8f77ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:29 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Volume volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 (7fa4a4ab-64dc-441a-a2cc-6a9d41079af6): created successfully Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8136d2-b98f-4444-a3f4-383a5a8f77ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (6a469eb0-262a-4035-bbdb-f44dfa2b96e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-204cba14-7be7-4f1a-a284-a6f4973b8a21 tempest-VolumesSnapshotTestJSON-603215442 None] Created volume successfully. Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d000a8fa-3c0b-4024-97ab-adf82b8fc23b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:30 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 Jul 08 18:49:30 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:31 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" returned: 0 in 0.951s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:31 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6 Jul 08 18:49:31 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Flow 'volume_create_manager' (628c6853-a060-4ea7-8270-eea47569d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d9578f-28fc-43e7-8339-b5f870ddd834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d9578f-28fc-43e7-8339-b5f870ddd834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-667656728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6279f76211864c7fb0abd3e6636c7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:32Z,use_quota=True,user_id='b4dba2a1fc8e4c1ba6e582577254f663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5411b12-9c26-430e-9782-275fb5639d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5411b12-9c26-430e-9782-275fb5639d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c6b35-5768-401a-a18d-18b8bc982651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c6b35-5768-401a-a18d-18b8bc982651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e', 'volume_name': 'volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74404d0-99bc-4848-9360-52a9c77dd6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74404d0-99bc-4848-9360-52a9c77dd6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5c3446-d921-43ac-ab1d-14cb7123bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:31 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Volume 3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e', 'volume_size': 1} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-667656728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6279f76211864c7fb0abd3e6636c7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:32Z,use_quota=True,user_id='b4dba2a1fc8e4c1ba6e582577254f663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Creating volume 3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:31 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:31 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e 1073741824 Jul 08 18:49:31 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:32 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6" released by "delete_volume" :: held 1.745s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['fdabffc7-4372-4d6c-a916-3b975df3ae15', '8887b188-e5aa-4363-97bd-cb2470e9bdfe', 'ba06d71b-d5e0-442c-9521-fee96043a391', 'c9279290-ebcc-4c92-952a-17da67bc96ce'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Flow 'volume_create_manager' (550dfb23-097a-419e-802c-2e4797027081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12349805-ed71-452e-91a7-3c06dabf6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12349805-ed71-452e-91a7-3c06dabf6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2130340014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454f79a5-88d1-4fca-bf65-d51e8209830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ff5a0ee3b74fbf924716c23c1d7972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:33Z,use_quota=True,user_id='b57e830b4b434933a17c6c20042bb68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c10a0f-83b6-41fb-8bbb-df8ff3bf699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c10a0f-83b6-41fb-8bbb-df8ff3bf699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:32 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:32 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5580bc-6d80-4b80-a498-4d108ec6beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5580bc-6d80-4b80-a498-4d108ec6beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454f79a5-88d1-4fca-bf65-d51e8209830f', 'volume_name': 'volume-454f79a5-88d1-4fca-bf65-d51e8209830f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874776b4-0143-4635-84f4-8a4d693dce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874776b4-0143-4635-84f4-8a4d693dce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53ba7ee-4f82-4fbb-91d5-27bc87870490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:32 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Volume 454f79a5-88d1-4fca-bf65-d51e8209830f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454f79a5-88d1-4fca-bf65-d51e8209830f', 'volume_size': 1} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:32 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e 1073741824" returned: 0 in 0.942s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-05fce39c-0d49-405a-985a-fc5b28e9e1f5-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:32 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e Jul 08 18:49:32 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-05fce39c-0d49-405a-985a-fc5b28e9e1f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Deleting offline snapshot 05fce39c-0d49-405a-985a-fc5b28e9e1f5 of volume 3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] snapshot_file for this snap is: volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f75610-3017-4bf1-8428-eefa17449bdf]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:33 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:33 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:33 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Deleted volume successfully. Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c037ecc-ed16-4ee6-a9d7-3750f6fa0351 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-7fa4a4ab-64dc-441a-a2cc-6a9d41079af6-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:33 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" returned: 0 in 0.664s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2130340014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454f79a5-88d1-4fca-bf65-d51e8209830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ff5a0ee3b74fbf924716c23c1d7972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:33Z,use_quota=True,user_id='b57e830b4b434933a17c6c20042bb68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Creating volume 454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:33 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:33 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f 1073741824 Jul 08 18:49:33 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5c3446-d921-43ac-ab1d-14cb7123bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85151855-dbc1-40fe-b3a8-ee09a506d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Volume volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e (3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e): created successfully Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85151855-dbc1-40fe-b3a8-ee09a506d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Flow 'volume_create_manager' (628c6853-a060-4ea7-8270-eea47569d36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1d809be4-b78e-4ce8-8d76-003b9b6f0787 tempest-VolumesTransfersV355Test-436064841 None] Created volume successfully. Jul 08 18:49:33 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 0.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a22b92-0512-4efa-bf8e-5f330443e55a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:34 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:34 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:34 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f 1073741824" returned: 0 in 0.948s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:34 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f Jul 08 18:49:34 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f1623a8d-fd56-4b17-a201-4eb2eb62549a tempest-VolumesTransfersV355Test-253282724 None] Transfer volume completed successfully. Jul 08 18:49:34 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:34 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:34 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (7fc1fbda-fecb-437c-82e7-151bff605a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e59e37-543b-45f1-ad72-36b6db05d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e59e37-543b-45f1-ad72-36b6db05d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479993415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb0746-aeed-4cfc-829f-ae7fc92499a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:35Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689952d8-6d87-4a4d-a3c2-5343fb162495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689952d8-6d87-4a4d-a3c2-5343fb162495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4c0f7-a6ec-4508-ac80-0544174bfc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4c0f7-a6ec-4508-ac80-0544174bfc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cb0746-aeed-4cfc-829f-ae7fc92499a9', 'volume_name': 'volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3006dfc2-63e0-40b1-973f-8731a2d7ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3006dfc2-63e0-40b1-973f-8731a2d7ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada190a-f444-4919-9e63-702b460dee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Volume e9cb0746-aeed-4cfc-829f-ae7fc92499a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9', 'volume_size': 1} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f" returned: 0 in 0.831s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479993415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb0746-aeed-4cfc-829f-ae7fc92499a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:35Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Creating volume e9cb0746-aeed-4cfc-829f-ae7fc92499a9 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:35 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53ba7ee-4f82-4fbb-91d5-27bc87870490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454f79a5-88d1-4fca-bf65-d51e8209830f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e781bb-4551-4ef9-b40e-f9043189fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:35 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 1073741824 Jul 08 18:49:35 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Volume volume-454f79a5-88d1-4fca-bf65-d51e8209830f (454f79a5-88d1-4fca-bf65-d51e8209830f): created successfully Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e781bb-4551-4ef9-b40e-f9043189fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Flow 'volume_create_manager' (550dfb23-097a-419e-802c-2e4797027081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-bde3361b-fb36-4a39-aaba-ad1b7e1053d8 req-3c830bf0-fb69-4bfa-af7d-435eb10e3c46 tempest-VolumesSnapshotsTestJSON-888443808 None] Created volume successfully. Jul 08 18:49:35 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 1.037s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:35 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5 Jul 08 18:49:35 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "cinder-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "cinder-quobyte-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-quobyte-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2399a84-0cc2-43f5-997a-5d051a4099b7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:36 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e Jul 08 18:49:36 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:36 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 1073741824" returned: 0 in 1.091s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:36 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 Jul 08 18:49:36 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:36 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a.05fce39c-0d49-405a-985a-fc5b28e9e1f5" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-05fce39c-0d49-405a-985a-fc5b28e9e1f5" released by "_delete_snapshot" :: held 3.688s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" released by "delete_snapshot" :: held 3.715s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['6ee06021-a81e-4789-acfb-67fbb497f0a7', 'c2a6d44f-17c0-46e0-b7e3-eb9db02fe205', '97d41733-d9be-4c98-8c4d-7d81885eb69a', '7024f20e-62b3-4fe4-b934-9789ff7e8bbd'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Delete snapshot completed successfully. Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-343ddcc1-8913-4650-b381-39e6dadbf99e tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-05fce39c-0d49-405a-985a-fc5b28e9e1f5-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:36 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" returned: 0 in 0.889s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:37 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e Jul 08 18:49:37 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:37 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.767s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada190a-f444-4919-9e63-702b460dee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd04dc9-5d9b-4fd5-be4f-05cb473157af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Creating offline snapshot f72af77a-99e1-4137-a580-a893b9483169 of volume 454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:49:37 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Volume volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 (e9cb0746-aeed-4cfc-829f-ae7fc92499a9): created successfully Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd04dc9-5d9b-4fd5-be4f-05cb473157af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (7fc1fbda-fecb-437c-82e7-151bff605a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-3dba7386-3e9b-46d2-8bd3-369e47977b8a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab079685-816f-45a0-a9b5-92451369466d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:37 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-fd11c5de-bb9e-4d42-bb4b-ad1fa8e2af65 tempest-AttachVolumeTestJSON-325360765 None] Created volume successfully. Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-3dba7386-3e9b-46d2-8bd3-369e47977b8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0cfe8f-6a7e-49b1-a520-f2a301f971f6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:37 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f Jul 08 18:49:37 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:37 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-quobyte-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e" released by "delete_volume" :: held 1.632s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:37 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:37 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Created reservations ['7f7aab65-c0a1-4f8e-8a7c-fa3eec726471', '682d05c7-c62d-49a2-b4ce-ee3c648710ea', '1a68869e-d5cc-44ce-b07b-2e4dcb5dfde0', '6fd7766b-ec73-43ca-ab5f-74a5a15a9da7'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:37 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:37 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:38 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f" returned: 0 in 0.905s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:38 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 0.813s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:38 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 1G Jul 08 18:49:38 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:38 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a Jul 08 18:49:38 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:38 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Deleted volume successfully. Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-842e0a8a-3b2a-43dd-b1d1-9910651cd672 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-3e0d7a87-6b48-4c68-a9e2-0cddc6bd116e-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Flow 'volume_create_manager' (fff0d0ef-47b3-4b91-8bea-e3cf46a3fab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d7de36-7542-41f1-b37a-763bce3059bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d7de36-7542-41f1-b37a-763bce3059bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-566803657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e9d6f3-adb8-4665-8852-7b34a06ed408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6279f76211864c7fb0abd3e6636c7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:39Z,use_quota=True,user_id='b4dba2a1fc8e4c1ba6e582577254f663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb4ed2-0e64-42b1-a464-b26362157210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb4ed2-0e64-42b1-a464-b26362157210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16871471-be4c-408e-8afb-7b490db34da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16871471-be4c-408e-8afb-7b490db34da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e9d6f3-adb8-4665-8852-7b34a06ed408', 'volume_name': 'volume-70e9d6f3-adb8-4665-8852-7b34a06ed408', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0da5ba-a3ef-4c5a-a790-ba53361c9019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0da5ba-a3ef-4c5a-a790-ba53361c9019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7be96-f657-4cbf-877d-7488183f6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Volume 70e9d6f3-adb8-4665-8852-7b34a06ed408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e9d6f3-adb8-4665-8852-7b34a06ed408', 'volume_size': 1} Jul 08 18:49:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:39 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3dba7386-3e9b-46d2-8bd3-369e47977b8a" returned: 0 in 0.828s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-3dba7386-3e9b-46d2-8bd3-369e47977b8a" released by "delete_volume" :: held 1.702s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['dee3be0c-700a-42f7-86db-704656714e2f', '0f35e5a6-87e5-48b2-8374-8716917bb694', '89cca7af-b6db-4a19-a958-dce5b79dbac1', '4b1b7b0e-883e-453e-b8a5-8966d4630916'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:39 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 1G" returned: 0 in 0.982s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454f79a5-88d1-4fca-bf65-d51e8209830f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:39 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454f79a5-88d1-4fca-bf65-d51e8209830f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 Jul 08 18:49:39 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:39 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:39 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:40 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.696s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Deleted volume successfully. Jul 08 18:49:40 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-454f79a5-88d1-4fca-bf65-d51e8209830f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169" returned: 0 in 0.771s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:40 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 is being set with open permissions: ugo+rw Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4833faa6-c7df-47af-abc6-ccae805c417a tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-3dba7386-3e9b-46d2-8bd3-369e47977b8a-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:40 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 Jul 08 18:49:40 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (81529de1-120f-4a9c-92c9-4617eb6277f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3306ba5e-3cbc-42a5-b4c3-7020e74f5542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3306ba5e-3cbc-42a5-b4c3-7020e74f5542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-653987059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6451ef63-36c1-49de-8a07-190d04e3bd48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:40Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689605f7-8496-482e-93c4-e2d134ca2f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689605f7-8496-482e-93c4-e2d134ca2f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c1745-de88-400e-bf3a-d991ea8cd6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c1745-de88-400e-bf3a-d991ea8cd6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6451ef63-36c1-49de-8a07-190d04e3bd48', 'volume_name': 'volume-6451ef63-36c1-49de-8a07-190d04e3bd48', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67216728-2843-49c2-960e-4850c88f2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67216728-2843-49c2-960e-4850c88f2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d2cff-c7ed-47d6-9484-a2357ccea217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:40 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Volume 6451ef63-36c1-49de-8a07-190d04e3bd48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6451ef63-36c1-49de-8a07-190d04e3bd48', 'volume_size': 1} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:40 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:40 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info Jul 08 18:49:40 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:41 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info" returned: 0 in 0.701s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:41 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info is being set with open permissions: ugo+rw Jul 08 18:49:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:41 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info Jul 08 18:49:41 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:42 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.info" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.864s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.305s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-566803657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e9d6f3-adb8-4665-8852-7b34a06ed408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6279f76211864c7fb0abd3e6636c7cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:39Z,use_quota=True,user_id='b4dba2a1fc8e4c1ba6e582577254f663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Creating volume 70e9d6f3-adb8-4665-8852-7b34a06ed408 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:42 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:42 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 1073741824 Jul 08 18:49:42 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-5498f5cb-b29e-45ca-a7c7-5abee13b1b20 req-3362a1dc-ea5f-4c70-8bfa-773002953828 tempest-VolumesSnapshotsTestJSON-888443808 None] Create snapshot completed successfully Jul 08 18:49:43 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 1073741824" returned: 0 in 0.825s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:43 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 Jul 08 18:49:43 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "cinder-f72af77a-99e1-4137-a580-a893b9483169-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-f72af77a-99e1-4137-a580-a893b9483169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "cinder-quobyte-f72af77a-99e1-4137-a580-a893b9483169" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-f72af77a-99e1-4137-a580-a893b9483169" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Deleting offline snapshot f72af77a-99e1-4137-a580-a893b9483169 of volume 454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] snapshot_file for this snap is: volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6859f3cc-e079-4e55-aaf9-7ff592d6c4f2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:43 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 Jul 08 18:49:43 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:43 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408" returned: 0 in 0.699s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.462s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-653987059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6451ef63-36c1-49de-8a07-190d04e3bd48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:40Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Creating volume 6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7be96-f657-4cbf-877d-7488183f6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e9d6f3-adb8-4665-8852-7b34a06ed408', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fc4bb6-a0f6-49fe-b281-7921893580af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:43 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 1073741824 Jul 08 18:49:43 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Volume volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 (70e9d6f3-adb8-4665-8852-7b34a06ed408): created successfully Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fc4bb6-a0f6-49fe-b281-7921893580af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Flow 'volume_create_manager' (fff0d0ef-47b3-4b91-8bea-e3cf46a3fab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-fd1230ac-1db4-4198-ac85-2090aae8c3ad tempest-VolumesTransfersV355Test-436064841 None] Created volume successfully. Jul 08 18:49:44 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169" returned: 0 in 0.852s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-454f79a5-88d1-4fca-bf65-d51e8209830f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e10ba-13f8-4323-8704-e24c0537953d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:44 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f Jul 08 18:49:44 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "cinder-70e9d6f3-adb8-4665-8852-7b34a06ed408-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-70e9d6f3-adb8-4665-8852-7b34a06ed408-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "cinder-quobyte-70e9d6f3-adb8-4665-8852-7b34a06ed408" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-quobyte-70e9d6f3-adb8-4665-8852-7b34a06ed408" acquired by "delete_volume" :: waited 0.040s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c755d2-cd27-44a5-a2c4-d3a4f7b4afa7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:44 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 Jul 08 18:49:44 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:44 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 1073741824" returned: 0 in 1.090s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:45 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:49:45 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:45 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f" returned: 0 in 0.903s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:45 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 Jul 08 18:49:45 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:45 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408" returned: 0 in 0.906s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:45 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408 Jul 08 18:49:45 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:45 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.030s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc7c7ee-964d-482d-9911-839e017c09c0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d2cff-c7ed-47d6-9484-a2357ccea217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6451ef63-36c1-49de-8a07-190d04e3bd48', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c3bb93-f414-44a4-aa98-ca9d5a0f792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:45 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Volume volume-6451ef63-36c1-49de-8a07-190d04e3bd48 (6451ef63-36c1-49de-8a07-190d04e3bd48): created successfully Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c3bb93-f414-44a4-aa98-ca9d5a0f792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (81529de1-120f-4a9c-92c9-4617eb6277f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-61de5277-7953-4f71-be0c-8cc5b6dc0efe tempest-VolumesSnapshotTestJSON-603215442 None] Created volume successfully. Jul 08 18:49:45 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 Jul 08 18:49:45 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:46 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169" returned: 0 in 0.878s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:46 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169 Jul 08 18:49:46 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:46 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-70e9d6f3-adb8-4665-8852-7b34a06ed408" returned: 0 in 0.778s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-quobyte-70e9d6f3-adb8-4665-8852-7b34a06ed408" released by "delete_volume" :: held 1.768s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Created reservations ['fc17f2e2-5ec5-47e8-a093-bd12a22de921', 'f438f63f-3d27-4230-9f31-b85fb2763e0c', 'a89f2256-18e8-4da0-bfb5-35ed25753cc3', '1615ca4a-c6d7-42ba-97d9-6523a35eec09'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:46 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:46 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:46 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" returned: 0 in 0.844s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08c4f34d-ad23-4513-9a36-91067b1ae51e', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:49:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-02ebc061-a50f-4ea1-b839-63089d521744 req-508c1ad2-7088-4fec-b0fc-1960d7103b0f tempest-AttachVolumeTestJSON-325360765 None] attachment_update completed successfully. Jul 08 18:49:46 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f.f72af77a-99e1-4137-a580-a893b9483169" returned: 0 in 0.748s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-f72af77a-99e1-4137-a580-a893b9483169" released by "_delete_snapshot" :: held 3.508s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" released by "delete_snapshot" :: held 3.539s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG cinder.quota [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Created reservations ['e5e9813e-4ab7-4bbd-9b27-0092ef183a1c', 'f9611bfb-d624-45cf-b576-b24b5d0af08c', '16691b30-1cc9-4d11-9fc4-52270edd4a92', '3e2faa96-56f1-45c5-937d-96cc247866f0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Creating offline snapshot a1634228-54aa-4fe9-8194-88e203ff61c5 of volume 6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:49:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Delete snapshot completed successfully. Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93147824-4a33-4fbb-996e-fdd2782eebb0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-83befe1d-ce84-441a-8c32-f84790a81fb8 req-dbfd9bcc-b951-4c96-aba4-9b39c3d3bcb3 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-f72af77a-99e1-4137-a580-a893b9483169-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:47 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:49:47 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:47 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.848s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Deleted volume successfully. Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f0a76774-798d-4cbd-adf2-f6b56396ad56 tempest-VolumesTransfersV355Test-1602421156 None] Lock "cinder-70e9d6f3-adb8-4665-8852-7b34a06ed408-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "cinder-454f79a5-88d1-4fca-bf65-d51e8209830f-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-454f79a5-88d1-4fca-bf65-d51e8209830f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb574860-d553-4d85-b120-cff04a4563a6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:47 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f Jul 08 18:49:47 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:47 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 0.917s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:48 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 1G Jul 08 18:49:48 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:48 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f" returned: 0 in 0.965s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:48 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f Jul 08 18:49:48 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:49 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 1G" returned: 0 in 1.049s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451ef63-36c1-49de-8a07-190d04e3bd48 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:49 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451ef63-36c1-49de-8a07-190d04e3bd48 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:49:49 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:49 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-454f79a5-88d1-4fca-bf65-d51e8209830f" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-quobyte-454f79a5-88d1-4fca-bf65-d51e8209830f" released by "delete_volume" :: held 1.815s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG cinder.quota [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Created reservations ['0f4579d7-a5e3-421c-a0bb-b8739fc3ea7d', '8c1655a3-043d-4d88-9ce0-26c319404fd3', 'f2f373e2-b6d7-4e92-91b0-382db148043c', '1d953a47-c9f5-4934-9a35-75bb231a23b4'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:49 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:49:49 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:49 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6451ef63-36c1-49de-8a07-190d04e3bd48 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:49 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 is being set with open permissions: ugo+rw Jul 08 18:49:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:49 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:49:49 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:50 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.799s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:50 devstack cinder-volume[87229]: DEBUG cinder.manager [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:49:50 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Deleted volume successfully. Jul 08 18:49:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-4167cc19-86ba-485b-aa5b-e1758fb8d954 req-21ebc47e-2ee5-4702-92c3-0e77e11e3508 tempest-VolumesSnapshotsTestJSON-888443808 None] Lock "cinder-454f79a5-88d1-4fca-bf65-d51e8209830f-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:49:50 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 0.831s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:50 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info Jul 08 18:49:50 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:51 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:51 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info is being set with open permissions: ugo+rw Jul 08 18:49:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:51 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info Jul 08 18:49:51 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:52 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.info" returned: 0 in 0.911s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.425s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8e4dd802-72aa-4622-b933-5d5a27d974ef tempest-VolumesSnapshotTestJSON-603215442 None] Create snapshot completed successfully Jul 08 18:49:53 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (cd501fcb-73f7-49b2-a5ae-3ed41036a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ef191a-193f-4798-8036-b3acfc2d912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ef191a-193f-4798-8036-b3acfc2d912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-508498415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e515fed1-b857-4498-9489-3d823308b5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747cd12d64740b8904e1b46980f5b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1634228-54aa-4fe9-8194-88e203ff61c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:54Z,use_quota=True,user_id='d52253c748644250981e312ed1f61cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0d59e-ccc9-4409-abe4-640bca4b9437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0d59e-ccc9-4409-abe4-640bca4b9437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c62c086-f2a5-49e2-86d4-15cbae80df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c62c086-f2a5-49e2-86d4-15cbae80df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e515fed1-b857-4498-9489-3d823308b5e3', 'volume_name': 'volume-e515fed1-b857-4498-9489-3d823308b5e3', 'volume_size': 1, 'snapshot_id': 'a1634228-54aa-4fe9-8194-88e203ff61c5'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e62e91-cf07-4ec9-9027-2f539f764860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e62e91-cf07-4ec9-9027-2f539f764860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf9d880-d63b-4ce3-8900-f873c479fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Volume e515fed1-b857-4498-9489-3d823308b5e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e515fed1-b857-4498-9489-3d823308b5e3', 'volume_size': 1, 'snapshot_id': 'a1634228-54aa-4fe9-8194-88e203ff61c5'} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5-e515fed1-b857-4498-9489-3d823308b5e3" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5-e515fed1-b857-4498-9489-3d823308b5e3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Creating volume e515fed1-b857-4498-9489-3d823308b5e3 from snapshot a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] snapshot: a1634228-54aa-4fe9-8194-88e203ff61c5, volume: e515fed1-b857-4498-9489-3d823308b5e3, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9cad4-1b32-459b-8809-67d2fef0938d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:54 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:49:54 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0f89ba8d-e62c-4eca-8dd9-4c18de6843de tempest-GroupSnapshotsV319Test-1845058558 None] Group tempest-GroupSnapshotsV319Test-Group-592045521: creating Jul 08 18:49:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0f89ba8d-e62c-4eca-8dd9-4c18de6843de tempest-GroupSnapshotsV319Test-1845058558 None] Group tempest-GroupSnapshotsV319Test-Group-592045521: created successfully Jul 08 18:49:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0f89ba8d-e62c-4eca-8dd9-4c18de6843de tempest-GroupSnapshotsV319Test-1845058558 None] Create group completed successfully. Jul 08 18:49:55 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 0.955s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6451ef63-36c1-49de-8a07-190d04e3bd48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a42a58-8857-4a35-bfae-577ef54847cb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:49:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:55 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:49:55 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:56 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 08 18:49:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:49:56 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:49:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:49:56 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 Jul 08 18:49:56 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Flow 'volume_create_manager' (ea43396d-a41d-48ab-aa52-65ba7e2b3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5838b8d1-d09d-4df5-adf9-b56a1a16ba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5838b8d1-d09d-4df5-adf9-b56a1a16ba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2027846035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddea38ec-3849-4bae-b2d2-0a7299c87a6f,host='devstack@QuobyteHD#QuobyteHD',id=b974d5f8-3fec-4981-910c-56c3912da0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c9387decbc49bd8b0fb30f8699883e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:57Z,use_quota=True,user_id='af18cdd8140d4ed48d0c09f61a0d2121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee779878-1056-4b5e-901a-9eed3380b30f),volume_type_id=ee779878-1056-4b5e-901a-9eed3380b30f)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ab7690-07f1-4492-bf11-db79d09d36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ab7690-07f1-4492-bf11-db79d09d36bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e170d58d-4d7e-420f-bdbd-f3fcb9d32e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e170d58d-4d7e-420f-bdbd-f3fcb9d32e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b974d5f8-3fec-4981-910c-56c3912da0ec', 'volume_name': 'volume-b974d5f8-3fec-4981-910c-56c3912da0ec', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d031023-ae6e-4a60-bc8a-705015486e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d031023-ae6e-4a60-bc8a-705015486e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8945a0-4cd0-440e-b882-5f5b8c7fd84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:49:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Volume b974d5f8-3fec-4981-910c-56c3912da0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b974d5f8-3fec-4981-910c-56c3912da0ec', 'volume_size': 1} Jul 08 18:49:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:02 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3" returned: 0 in 6.230s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36378e35-b6ae-441d-8765-0c13e4c53a02]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:02 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:50:02 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:03 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 1.048s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:03 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:50:03 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Converted 1024.00 MB image at 164.35 MB/s Jul 08 18:50:03 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 is being set with open permissions: ugo+rw Jul 08 18:50:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:03 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 Jul 08 18:50:03 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:04 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3" returned: 0 in 0.752s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" released by "_copy_volume_from_snapshot" :: held 9.912s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5-e515fed1-b857-4498-9489-3d823308b5e3" released by "_create_volume_from_snapshot" :: held 9.957s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.984s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.935s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddea38ec-3849-4bae-b2d2-0a7299c87a6f,created_at=2026-07-08T16:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2027846035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddea38ec-3849-4bae-b2d2-0a7299c87a6f,host='devstack@QuobyteHD#QuobyteHD',id=b974d5f8-3fec-4981-910c-56c3912da0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c9387decbc49bd8b0fb30f8699883e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:49:57Z,use_quota=True,user_id='af18cdd8140d4ed48d0c09f61a0d2121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee779878-1056-4b5e-901a-9eed3380b30f),volume_type_id=ee779878-1056-4b5e-901a-9eed3380b30f)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Creating volume b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:04 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:04 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec 1073741824 Jul 08 18:50:04 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf9d880-d63b-4ce3-8900-f873c479fb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e515fed1-b857-4498-9489-3d823308b5e3', 'volume_size': 1, 'snapshot_id': 'a1634228-54aa-4fe9-8194-88e203ff61c5'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71877da9-7f1b-40c3-bfa3-bd326f566161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Volume volume-e515fed1-b857-4498-9489-3d823308b5e3 (e515fed1-b857-4498-9489-3d823308b5e3): created successfully Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71877da9-7f1b-40c3-bfa3-bd326f566161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Flow 'volume_create_manager' (cd501fcb-73f7-49b2-a5ae-3ed41036a176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d6c2c44e-3ec9-4ad9-a5ab-e0bda0a0a62f tempest-VolumesSnapshotTestJSON-603215442 None] Created volume successfully. Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-e515fed1-b857-4498-9489-3d823308b5e3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:05 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-e515fed1-b857-4498-9489-3d823308b5e3-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec 1073741824" returned: 0 in 1.601s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:05 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec Jul 08 18:50:05 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" acquired by "delete_volume" :: waited 0.049s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:06 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13467ae2-104b-4268-9d6b-b20bf6124b42]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:06 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 Jul 08 18:50:06 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:07 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec" returned: 0 in 1.342s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] <== create_volume: return (3108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.117s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8945a0-4cd0-440e-b882-5f5b8c7fd84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b974d5f8-3fec-4981-910c-56c3912da0ec', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d39c5f-3fef-4f4d-873e-f0ae13c296f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Volume volume-b974d5f8-3fec-4981-910c-56c3912da0ec (b974d5f8-3fec-4981-910c-56c3912da0ec): created successfully Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d39c5f-3fef-4f4d-873e-f0ae13c296f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Flow 'volume_create_manager' (ea43396d-a41d-48ab-aa52-65ba7e2b3926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3083655a-c2b9-4dc8-a23a-1b682d909de2 tempest-GroupSnapshotsV319Test-1845058558 None] Created volume successfully. Jul 08 18:50:07 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3" returned: 0 in 1.407s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:07 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3 Jul 08 18:50:07 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] GroupSnapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: creating. Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Group snapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: creating. {{(pid=87229) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Creating offline snapshot ee2140d1-671e-4c81-9b34-5274bc4f0944 of volume b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4886d31a-222e-4d8d-9cf1-dce7432542b6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:08 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec Jul 08 18:50:08 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:09 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e515fed1-b857-4498-9489-3d823308b5e3" returned: 0 in 1.704s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-e515fed1-b857-4498-9489-3d823308b5e3" released by "delete_volume" :: held 3.203s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['11b38f7d-db21-430b-924e-d9c4e14c0965', '29e208bf-71e6-4fba-95ee-028455642231', 'b829de8b-c76a-47b0-8852-6dddcd707e89', '20b7e49f-b2bb-4d1a-8a03-c742d9537e7a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:09 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:09 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:10 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec" returned: 0 in 1.461s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:10 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 1G Jul 08 18:50:10 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:10 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.919s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Deleted volume successfully. Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-da1382b5-f85b-4b59-8921-1e0e69c6b754 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-e515fed1-b857-4498-9489-3d823308b5e3-delete_volume" released by "delete_volume" :: held 4.816s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-a1634228-54aa-4fe9-8194-88e203ff61c5-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-a1634228-54aa-4fe9-8194-88e203ff61c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Deleting offline snapshot a1634228-54aa-4fe9-8194-88e203ff61c5 of volume 6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] snapshot_file for this snap is: volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9080b29-5b40-4ed3-a0a3-6c4687507efa]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:10 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:50:10 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:11 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 1G" returned: 0 in 1.137s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b974d5f8-3fec-4981-910c-56c3912da0ec -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:11 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b974d5f8-3fec-4981-910c-56c3912da0ec -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 Jul 08 18:50:11 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:11 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 0.919s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6451ef63-36c1-49de-8a07-190d04e3bd48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a2b17-caee-4c41-b83e-372f473cbcfc]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:11 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:50:11 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:12 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b974d5f8-3fec-4981-910c-56c3912da0ec -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944" returned: 0 in 0.925s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:12 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:50:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:12 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 Jul 08 18:50:12 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:12 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 0.947s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:12 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:50:12 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:13 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944" returned: 0 in 1.069s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:13 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info Jul 08 18:50:13 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:13 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 1.270s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:14 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5 Jul 08 18:50:14 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:14 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info" returned: 0 in 0.836s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:14 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:14 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info Jul 08 18:50:14 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:14 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48.a1634228-54aa-4fe9-8194-88e203ff61c5" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=80,cinder:INSERT=25,cinder:UPDATE=103,cinder:DELETE=10 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-a1634228-54aa-4fe9-8194-88e203ff61c5" released by "_delete_snapshot" :: held 4.088s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" released by "delete_snapshot" :: held 4.126s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['57a5f221-8050-4e95-9ed2-2db33c077173', '25fe1cf7-03f2-43a9-bfd0-fa6466b2c858', '708c2a53-0e1e-465d-8435-6ffecb5dea21', '529c5f2d-f206-47f1-a766-fa6039381208'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Delete snapshot completed successfully. Jul 08 18:50:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b6658f93-c2de-4836-8f39-232dbb58766d tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-a1634228-54aa-4fe9-8194-88e203ff61c5-delete_snapshot" released by "delete_snapshot" :: held 4.344s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:15 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.info" returned: 0 in 1.066s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.672s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0bffc4e6-2605-4891-a26b-dfc0b6210480 tempest-GroupSnapshotsV319Test-1845058558 None] group_snapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: created successfully Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-6451ef63-36c1-49de-8a07-190d04e3bd48-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-6451ef63-36c1-49de-8a07-190d04e3bd48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] group_snapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: deleting Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f21b572-09a6-486f-9c28-3304c8495285]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] group_snapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: deleting {{(pid=87229) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "cinder-quobyte-ee2140d1-671e-4c81-9b34-5274bc4f0944" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-ee2140d1-671e-4c81-9b34-5274bc4f0944" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Deleting offline snapshot ee2140d1-671e-4c81-9b34-5274bc4f0944 of volume b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] snapshot_file for this snap is: volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836d542-829e-4cc7-92d5-9a35e747d349]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:16 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:50:16 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:16 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 Jul 08 18:50:16 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:17 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944" returned: 0 in 0.945s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b974d5f8-3fec-4981-910c-56c3912da0ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6ceee-eb05-425c-86c9-a3239e980a54]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:17 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 1.239s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:17 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48 Jul 08 18:50:17 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:17 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec Jul 08 18:50:17 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:18 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:18 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:18 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6451ef63-36c1-49de-8a07-190d04e3bd48" returned: 0 in 0.949s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-6451ef63-36c1-49de-8a07-190d04e3bd48" released by "delete_volume" :: held 2.355s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:18 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['3be78ad4-8d44-458b-87f9-aecb6b625161', '40185b54-20e7-4e47-b0f3-d4ca2084fef8', '1ba9957f-bee6-4403-bb5a-4d7ea1d7191c', '79eaa81e-b7a6-4516-a545-2c1d29362f6e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:19 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec" returned: 0 in 1.458s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:19 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:19 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:19 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 Jul 08 18:50:19 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:19 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.242s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-f37746bf-e083-4954-854a-2934bb8872b2-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-f37746bf-e083-4954-854a-2934bb8872b2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:20 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.950s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Deleted volume successfully. Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec307e1-a6e2-4491-9b1b-f18399d9f3ea]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f4ff06f-292d-4235-ad90-15dce696c2c8 tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-6451ef63-36c1-49de-8a07-190d04e3bd48-delete_volume" released by "delete_volume" :: held 3.855s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:20 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 Jul 08 18:50:20 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:20 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944" returned: 0 in 1.244s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:20 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944 Jul 08 18:50:20 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:21 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2" returned: 0 in 1.047s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:21 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2 Jul 08 18:50:21 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:21 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec.ee2140d1-671e-4c81-9b34-5274bc4f0944" returned: 0 in 0.869s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-ee2140d1-671e-4c81-9b34-5274bc4f0944" released by "_delete_snapshot" :: held 4.693s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" released by "delete_snapshot" :: held 4.744s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:21 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-153519243 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-153519243, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:50:21 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-153519243 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-153519243, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] Created reservations ['3f097401-e0f3-4417-963c-1fc4a77ab8fc', 'ad0062f2-1d77-4268-9dc8-fad578eb4cf0', '9d578a9a-e0d7-4a30-bbfa-6610af260a8c', '37af7c5a-8bde-4f1a-99a5-54f57cd65b06'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e4300f75-16d7-4d1a-97f7-e9aa32c729f0 tempest-GroupSnapshotsV319Test-1845058558 None] group_snapshot 661d48d2-0a30-4c80-bee3-1e5b995a26f1: deleted successfully Jul 08 18:50:21 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f37746bf-e083-4954-854a-2934bb8872b2" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-quobyte-f37746bf-e083-4954-854a-2934bb8872b2" released by "delete_volume" :: held 1.860s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Created reservations ['92ec56a7-2fd4-4f56-987d-af07b7816477', '838aa6c3-af6f-4f5c-95de-a7f4f9cc32c2', 'f36ef241-ae88-4326-95b0-dd70f5e14344', '7e22a00f-8a34-474f-9ca9-6d74b73d354c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:22 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:22 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8b86d-0529-44f5-bc53-5c051ad5e7d6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:22 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec Jul 08 18:50:22 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:22 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.828s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Deleted volume successfully. Jul 08 18:50:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c4b0266d-db9a-4b47-84a2-36530306a1dc tempest-VolumesSnapshotTestJSON-603215442 None] Lock "cinder-f37746bf-e083-4954-854a-2934bb8872b2-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:23 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec" returned: 0 in 1.018s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:23 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec Jul 08 18:50:23 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:24 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b974d5f8-3fec-4981-910c-56c3912da0ec" returned: 0 in 0.856s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Lock "cinder-quobyte-b974d5f8-3fec-4981-910c-56c3912da0ec" released by "delete_volume" :: held 1.977s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Created reservations ['08d28b1a-85e4-4ff1-a858-55055f094473'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:24 devstack cinder-volume[87229]: WARNING cinder.quota [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-153519243 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-153519243, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Created reservations ['36a22016-2c44-44b5-9e1d-9511c628a3ce', '57462b87-1006-4ad6-aa5a-e2c8b1162565', 'bbf5a6ce-1f16-4c01-8578-0abb01157f72', '5a7f5431-4a5f-43b9-a88e-a5c4b39fdc83'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:24 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:24 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:25 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.816s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:25 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-40947d37-d775-4671-b675-6428a969b6ef tempest-GroupSnapshotsV319Test-1845058558 None] Delete group completed successfully. Jul 08 18:50:30 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=114,cinder:UPDATE=125,cinder:DELETE=9,cinder:INSERT=32 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:50:30 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-3e01c741-3177-4aa9-95fb-9e87d55639f3 req-5656393e-0bef-4625-b501-6f4654fc8671 tempest-AttachVolumeTestJSON-325360765 None] Terminate volume connection completed successfully. Jul 08 18:50:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-3e01c741-3177-4aa9-95fb-9e87d55639f3 req-5656393e-0bef-4625-b501-6f4654fc8671 tempest-AttachVolumeTestJSON-325360765 None] Deleting attachment 08c4f34d-ad23-4513-9a36-91067b1ae51e. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (15a11f18-f67d-4dbe-8ea7-22b77071469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0f9c65-0b2a-4d2f-8a68-d9d088c99d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0f9c65-0b2a-4d2f-8a68-d9d088c99d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-986474656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d711e41-42ab-4f74-b967-22a2c3992ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:34Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60877ca9-1464-4bbc-9739-c5bcb1c1a7da),volume_type_id=60877ca9-1464-4bbc-9739-c5bcb1c1a7da)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9487c6-5874-48ec-a0f8-543b4d7e1d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9487c6-5874-48ec-a0f8-543b4d7e1d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342f961d-0834-41d6-baac-945effcfb9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342f961d-0834-41d6-baac-945effcfb9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d711e41-42ab-4f74-b967-22a2c3992ca7', 'volume_name': 'volume-9d711e41-42ab-4f74-b967-22a2c3992ca7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b10253-d7d8-4f6d-9b91-986c0da3a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b10253-d7d8-4f6d-9b91-986c0da3a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa48ce26-92a4-4525-ae96-f76614188c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume 9d711e41-42ab-4f74-b967-22a2c3992ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d711e41-42ab-4f74-b967-22a2c3992ca7', 'volume_size': 1} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-986474656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d711e41-42ab-4f74-b967-22a2c3992ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:34Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60877ca9-1464-4bbc-9739-c5bcb1c1a7da),volume_type_id=60877ca9-1464-4bbc-9739-c5bcb1c1a7da)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Creating volume 9d711e41-42ab-4f74-b967-22a2c3992ca7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:33 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:33 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 1073741824 Jul 08 18:50:33 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (da90721e-a428-47b6-805a-638ed1a95903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a363bac-6525-4a0c-af89-6b1a749043b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a363bac-6525-4a0c-af89-6b1a749043b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1729092638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b512b345-e102-429f-ba38-cb6b4a71f291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:34Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f1dee01-8669-4d83-9b26-fd207df58a6e),volume_type_id=7f1dee01-8669-4d83-9b26-fd207df58a6e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff386db-f960-443e-acd7-1a422fb4de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff386db-f960-443e-acd7-1a422fb4de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ebc5ab-a8db-4a5d-9260-24ea392b7ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ebc5ab-a8db-4a5d-9260-24ea392b7ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b512b345-e102-429f-ba38-cb6b4a71f291', 'volume_name': 'volume-b512b345-e102-429f-ba38-cb6b4a71f291', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8eba72-a9c2-4042-9247-1c0de9b09f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8eba72-a9c2-4042-9247-1c0de9b09f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7330a-2b65-46b1-9fea-94fa7f8d85c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Volume b512b345-e102-429f-ba38-cb6b4a71f291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b512b345-e102-429f-ba38-cb6b4a71f291', 'volume_size': 1} Jul 08 18:50:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:35 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 1073741824" returned: 0 in 1.369s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:35 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 Jul 08 18:50:35 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (e594f700-ba02-4aff-9f37-6d8a3e2ef6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e95abb-cef4-4e45-b051-16daf29dd8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e95abb-cef4-4e45-b051-16daf29dd8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-973309855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:36Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da8566a-5097-4298-aba7-e6d018f13811),volume_type_id=1da8566a-5097-4298-aba7-e6d018f13811)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00e5979-fdfa-4a96-98f1-29e701ee6ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00e5979-fdfa-4a96-98f1-29e701ee6ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792806fb-b6d7-4335-9d2f-70e2b3308e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:50:36 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7" returned: 0 in 1.199s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.618s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.978s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1729092638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b512b345-e102-429f-ba38-cb6b4a71f291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:34Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f1dee01-8669-4d83-9b26-fd207df58a6e),volume_type_id=7f1dee01-8669-4d83-9b26-fd207df58a6e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Creating volume b512b345-e102-429f-ba38-cb6b4a71f291 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:36 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa48ce26-92a4-4525-ae96-f76614188c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d711e41-42ab-4f74-b967-22a2c3992ca7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 1073741824 Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda9a609-3551-483f-8317-8d3232e96e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:36 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 (9d711e41-42ab-4f74-b967-22a2c3992ca7): created successfully Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda9a609-3551-483f-8317-8d3232e96e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (15a11f18-f67d-4dbe-8ea7-22b77071469a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2d5b5adc-4e50-4e73-a8c5-c5dbc3b48666 tempest-TestInstancesWithCinderVolumes-997484351 None] Created volume successfully. Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792806fb-b6d7-4335-9d2f-70e2b3308e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1', 'volume_name': 'volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1', 'volume_size': 1, 'image_id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355210698', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a201efc74f1f4477916c31e023172507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'created_at': datetime.datetime(2026, 7, 8, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc9d46ff-6eae-4877-9c81-15cebfa19508/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f91f97b-3263-42e8-b0eb-65b42421c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f91f97b-3263-42e8-b0eb-65b42421c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a02c3b7-f32a-40e8-9b82-52f75a31a3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1', 'volume_size': 1, 'image_id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355210698', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a201efc74f1f4477916c31e023172507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'created_at': datetime.datetime(2026, 7, 8, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc9d46ff-6eae-4877-9c81-15cebfa19508/file', 'properties': {}}, 'image_service': } Jul 08 18:50:36 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Trying to clone fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 from image dc9d46ff-6eae-4877-9c81-15cebfa19508 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:50:37 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 1073741824" returned: 0 in 1.253s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:37 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 Jul 08 18:50:37 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:38 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291" returned: 0 in 1.219s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] <== create_volume: return (2545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7330a-2b65-46b1-9fea-94fa7f8d85c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b512b345-e102-429f-ba38-cb6b4a71f291', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5769a4bc-ac06-4d85-bf9f-fa8e9dd979cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:39 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Volume volume-b512b345-e102-429f-ba38-cb6b4a71f291 (b512b345-e102-429f-ba38-cb6b4a71f291): created successfully Jul 08 18:50:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5769a4bc-ac06-4d85-bf9f-fa8e9dd979cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (da90721e-a428-47b6-805a-638ed1a95903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-06f8583d-9927-4c7c-a69e-f8309b9d754c tempest-TestInstancesWithCinderVolumes-997484351 None] Created volume successfully. Jul 08 18:50:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f88a3d2a-a9bf-4716-b9f3-15b158924f31 tempest-GroupsTest-1768282538 None] Group tempest-Group1-1297522235: creating Jul 08 18:50:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f88a3d2a-a9bf-4716-b9f3-15b158924f31 tempest-GroupsTest-1768282538 None] Group tempest-Group1-1297522235: created successfully Jul 08 18:50:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f88a3d2a-a9bf-4716-b9f3-15b158924f31 tempest-GroupsTest-1768282538 None] Create group completed successfully. Jul 08 18:50:41 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD, size 20.69 MB, duration 4.64 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:50:41 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Image download 20.69 MB at 4.45 MB/s Jul 08 18:50:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9911ad-5e45-47bb-9d74-fcb05e8c2d93]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:41 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD Jul 08 18:50:41 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-26f31c16-8bb0-455a-919a-1d6b2976c809 tempest-GroupsTest-1768282538 None] Group tempest-Group2-1509213313: creating Jul 08 18:50:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-26f31c16-8bb0-455a-919a-1d6b2976c809 tempest-GroupsTest-1768282538 None] Group tempest-Group2-1509213313: created successfully Jul 08 18:50:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-26f31c16-8bb0-455a-919a-1d6b2976c809 tempest-GroupsTest-1768282538 None] Create group completed successfully. Jul 08 18:50:42 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD" returned: 0 in 1.100s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:42 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Temporary image dc9d46ff-6eae-4877-9c81-15cebfa19508 is fetched for user fb713f4d187046369ee163e39f8f863e. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:50:42 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ab8221-6e24-4b6a-9bc5-c0f5402df788]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:42 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD Jul 08 18:50:42 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:43 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-973309855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a201efc74f1f4477916c31e023172507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:36Z,use_quota=True,user_id='fb713f4d187046369ee163e39f8f863e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da8566a-5097-4298-aba7-e6d018f13811),volume_type_id=1da8566a-5097-4298-aba7-e6d018f13811)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Creating volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:43 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1073741824 Jul 08 18:50:43 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (10944a88-4cff-461a-acc2-cfdb149c0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d29a79d-6927-47e4-b6ce-1d0eb1a7188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d29a79d-6927-47e4-b6ce-1d0eb1a7188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-118853113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c71b081-5d74-441e-954f-530652ec506f,host='devstack@QuobyteHD#QuobyteHD',id=c82110fa-7186-4f1e-aa71-325daa2ec42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:44Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a0aa11-3402-42a1-916b-7f7096ab876c),volume_type_id=56a0aa11-3402-42a1-916b-7f7096ab876c)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7126d3c-2512-42bd-8884-3e10dc9dc3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7126d3c-2512-42bd-8884-3e10dc9dc3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c619cd3f-cc2b-4030-b9f8-34ac027204d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c619cd3f-cc2b-4030-b9f8-34ac027204d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82110fa-7186-4f1e-aa71-325daa2ec42a', 'volume_name': 'volume-c82110fa-7186-4f1e-aa71-325daa2ec42a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6103c62-c845-4e26-8f4b-d6d8e9b15b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6103c62-c845-4e26-8f4b-d6d8e9b15b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a65fd3e-d46a-4ec8-987a-ff807232676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:44 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Volume c82110fa-7186-4f1e-aa71-325daa2ec42a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82110fa-7186-4f1e-aa71-325daa2ec42a', 'volume_size': 1} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:44 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1073741824" returned: 0 in 1.287s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:44 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:50:44 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:45 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 1.120s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] <== create_volume: return (2486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c71b081-5d74-441e-954f-530652ec506f,created_at=2026-07-08T16:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-118853113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c71b081-5d74-441e-954f-530652ec506f,host='devstack@QuobyteHD#QuobyteHD',id=c82110fa-7186-4f1e-aa71-325daa2ec42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:44Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a0aa11-3402-42a1-916b-7f7096ab876c),volume_type_id=56a0aa11-3402-42a1-916b-7f7096ab876c)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Creating volume c82110fa-7186-4f1e-aa71-325daa2ec42a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:45 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:46 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a 1073741824 Jul 08 18:50:46 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:46 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Attempting download of dc9d46ff-6eae-4877-9c81-15cebfa19508 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}])) to volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:50:46 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4b55d-4292-4136-b96c-5d3dea753c81]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:46 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc Jul 08 18:50:46 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:47 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc" returned: 0 in 1.010s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:47 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc Jul 08 18:50:47 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:47 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a 1073741824" returned: 0 in 1.542s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:47 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a Jul 08 18:50:47 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:48 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc" returned: 1 in 1.162s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc9d46ff-6eae-4877-9c81-15cebfa19508_lihsymbc' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e98179-3eba-4d50-a1f1-ed0fcd39e528]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:48 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD Jul 08 18:50:48 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:48 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a" returned: 0 in 1.280s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] <== create_volume: return (2931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.940s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a65fd3e-d46a-4ec8-987a-ff807232676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82110fa-7186-4f1e-aa71-325daa2ec42a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e650291-5e71-4912-a5be-193837a3002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Volume volume-c82110fa-7186-4f1e-aa71-325daa2ec42a (c82110fa-7186-4f1e-aa71-325daa2ec42a): created successfully Jul 08 18:50:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e650291-5e71-4912-a5be-193837a3002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (10944a88-4cff-461a-acc2-cfdb149c0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ac70795c-965a-472a-96c6-f847b6f0f48a tempest-GroupsTest-1768282538 None] Created volume successfully. Jul 08 18:50:49 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD" returned: 0 in 1.222s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:49 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] dc9d46ff-6eae-4877-9c81-15cebfa19508 was qcow2, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:50:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:49 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:50:49 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Acquiring lock "cinder-quobyte-c82110fa-7186-4f1e-aa71-325daa2ec42a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:50:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-c82110fa-7186-4f1e-aa71-325daa2ec42a" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:50:50 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52148360-f66b-4d25-8b9b-63a62ba95d77]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:50 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a Jul 08 18:50:50 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:51 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a" returned: 0 in 1.113s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:51 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a Jul 08 18:50:51 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:52 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c82110fa-7186-4f1e-aa71-325daa2ec42a" returned: 0 in 0.904s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-c82110fa-7186-4f1e-aa71-325daa2ec42a" released by "delete_volume" :: held 2.073s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Created reservations ['e3efa43c-4330-40eb-a075-042cda6ea570'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:52 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1907182803 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1907182803, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:50:52 devstack cinder-volume[87229]: WARNING cinder.quota [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1907182803 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1907182803, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Created reservations ['c058c78a-0e94-45a9-884b-5e0d1e411964', 'e5ae043c-80d4-41a5-996a-065fa586e7db', 'fe28a4a7-b196-4165-bf94-5a517d2446d5', '31d63066-5037-416e-aa62-ba0a7d7493d1'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:52 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 2.741s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc9d46ff-6eae-4877-9c81-15cebfa19508_weaal6pcdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:50:52 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Converted 112.00 MB image at 40.85 MB/s Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:52 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1G Jul 08 18:50:52 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:52 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:52 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Created reservations ['a75edc92-ff59-4def-9913-19bb6ada6eb5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:53 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:50:53 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:53 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 1G" returned: 0 in 1.167s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a453112-b8be-405a-94be-8fd56ceadbd6]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:53 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.205s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:53 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e86324c3-cd93-4a85-b561-ccf7e3876452 tempest-GroupsTest-1768282538 None] Delete group completed successfully. Jul 08 18:50:53 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:50:53 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:54 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.906s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:54 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:50:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-68797d66-1457-4e90-a30a-74bfad81fc23 tempest-GroupsTest-1768282538 None] Delete group completed successfully. Jul 08 18:50:54 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 1.160s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-db98d8e8-7106-4461-ada2-f50fdfb45f91 tempest-GroupsTest-1768282538 None] Group tempest-GroupsTest-Group-260807802: creating Jul 08 18:50:54 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:50:54 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-db98d8e8-7106-4461-ada2-f50fdfb45f91 tempest-GroupsTest-1768282538 None] Group tempest-GroupsTest-Group-260807802: created successfully Jul 08 18:50:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-db98d8e8-7106-4461-ada2-f50fdfb45f91 tempest-GroupsTest-1768282538 None] Create group completed successfully. Jul 08 18:50:55 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 1 in 1.020s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Downloaded image dc9d46ff-6eae-4877-9c81-15cebfa19508 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}])) to volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Temporary image dc9d46ff-6eae-4877-9c81-15cebfa19508 for user fb713f4d187046369ee163e39f8f863e is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Marking volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Copying metadata from image dc9d46ff-6eae-4877-9c81-15cebfa19508 to fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Creating volume glance metadata for volume fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 backed by image dc9d46ff-6eae-4877-9c81-15cebfa19508 with: {'image_id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'image_name': 'tempest-scenario-img--355210698', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a02c3b7-f32a-40e8-9b82-52f75a31a3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1', 'volume_size': 1, 'image_id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc9d46ff-6eae-4877-9c81-15cebfa19508', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--355210698', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a201efc74f1f4477916c31e023172507', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dc9d46ff-6eae-4877-9c81-15cebfa19508', 'created_at': datetime.datetime(2026, 7, 8, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc9d46ff-6eae-4877-9c81-15cebfa19508/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c7de8-830b-4182-b97f-96a9632735a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Volume volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 (fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1): created successfully Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c7de8-830b-4182-b97f-96a9632735a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Flow 'volume_create_manager' (e594f700-ba02-4aff-9f37-6d8a3e2ef6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-95956e98-5dd2-45e7-befb-377fc37626d9 tempest-TestInstancesWithCinderVolumes-997484351 None] Created volume successfully. Jul 08 18:50:56 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:50:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (8f980d75-8709-44c8-9245-5bc9158c309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6df13-8aeb-4220-be6d-3a415ee0f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6df13-8aeb-4220-be6d-3a415ee0f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-487900098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=911af120-3988-4961-b92c-4a8cea7ee652,host='devstack@QuobyteHD#QuobyteHD',id=3b482672-d87e-4069-921c-c9fa88a38fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:57Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c369b241-dc28-45f8-b6a6-341f4335638a),volume_type_id=c369b241-dc28-45f8-b6a6-341f4335638a)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1cead-aeec-453f-8d3b-dbfb79a9770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd1cead-aeec-453f-8d3b-dbfb79a9770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb34c11-d27a-4621-9763-4864df9574d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb34c11-d27a-4621-9763-4864df9574d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b482672-d87e-4069-921c-c9fa88a38fea', 'volume_name': 'volume-3b482672-d87e-4069-921c-c9fa88a38fea', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27daf35-1dda-436f-8fc7-a64ee624d409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27daf35-1dda-436f-8fc7-a64ee624d409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b25be7-fc57-4355-b549-73543dbee332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Volume 3b482672-d87e-4069-921c-c9fa88a38fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b482672-d87e-4069-921c-c9fa88a38fea', 'volume_size': 1} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=911af120-3988-4961-b92c-4a8cea7ee652,created_at=2026-07-08T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-487900098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=911af120-3988-4961-b92c-4a8cea7ee652,host='devstack@QuobyteHD#QuobyteHD',id=3b482672-d87e-4069-921c-c9fa88a38fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:50:57Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c369b241-dc28-45f8-b6a6-341f4335638a),volume_type_id=c369b241-dc28-45f8-b6a6-341f4335638a)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Creating volume 3b482672-d87e-4069-921c-c9fa88a38fea {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:50:57 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:50:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:57 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea 1073741824 Jul 08 18:50:57 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:58 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea 1073741824" returned: 0 in 1.379s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:50:58 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea Jul 08 18:50:58 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:50:59 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b25be7-fc57-4355-b549-73543dbee332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b482672-d87e-4069-921c-c9fa88a38fea', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dbec22-abfa-4858-adf3-1d1a2c77ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:50:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Volume volume-3b482672-d87e-4069-921c-c9fa88a38fea (3b482672-d87e-4069-921c-c9fa88a38fea): created successfully Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dbec22-abfa-4858-adf3-1d1a2c77ed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:50:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (8f980d75-8709-44c8-9245-5bc9158c309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:50:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-31d7079a-b25d-4949-a656-cff1749e819e tempest-GroupsTest-1768282538 None] Created volume successfully. Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (4ca65a0d-25b5-45ba-93b4-d4e6712340a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b2d0d4-64c2-4867-a9ee-870221d714d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b2d0d4-64c2-4867-a9ee-870221d714d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746527064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=911af120-3988-4961-b92c-4a8cea7ee652,host='devstack@QuobyteHD#QuobyteHD',id=4237b4a0-aaf1-40b1-92f6-85dc70cf83a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:01Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c369b241-dc28-45f8-b6a6-341f4335638a),volume_type_id=c369b241-dc28-45f8-b6a6-341f4335638a)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbdb36c-1b06-4d76-854a-dc0c886ad347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbdb36c-1b06-4d76-854a-dc0c886ad347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e04710-11fa-4668-ad68-448d83e8a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e04710-11fa-4668-ad68-448d83e8a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4237b4a0-aaf1-40b1-92f6-85dc70cf83a2', 'volume_name': 'volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6aeb8-271a-49ac-b262-b498306fbaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a6aeb8-271a-49ac-b262-b498306fbaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770098c3-5ca7-4742-93e0-59967a7517c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Volume 4237b4a0-aaf1-40b1-92f6-85dc70cf83a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2', 'volume_size': 1} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=911af120-3988-4961-b92c-4a8cea7ee652,created_at=2026-07-08T16:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746527064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=911af120-3988-4961-b92c-4a8cea7ee652,host='devstack@QuobyteHD#QuobyteHD',id=4237b4a0-aaf1-40b1-92f6-85dc70cf83a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ef4ac50b324cdca61cc3cee9f53663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:01Z,use_quota=True,user_id='64fb92906f18468fb18376608cdd3c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c369b241-dc28-45f8-b6a6-341f4335638a),volume_type_id=c369b241-dc28-45f8-b6a6-341f4335638a)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Creating volume 4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:51:01 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:51:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:01 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 1073741824 Jul 08 18:51:01 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:02 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 1073741824" returned: 0 in 0.906s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:02 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 Jul 08 18:51:02 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:03 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" returned: 0 in 0.690s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770098c3-5ca7-4742-93e0-59967a7517c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2209aa39-2310-43ec-a792-1b02f9652cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Volume volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 (4237b4a0-aaf1-40b1-92f6-85dc70cf83a2): created successfully Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2209aa39-2310-43ec-a792-1b02f9652cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Flow 'volume_create_manager' (4ca65a0d-25b5-45ba-93b4-d4e6712340a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b8a998d2-54b8-4acb-bcb0-257cff317a1f tempest-GroupsTest-1768282538 None] Created volume successfully. Jul 08 18:51:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2da06c88-abf6-45ce-8b66-086468dfc89b tempest-GroupsTest-1768282538 None] Update group completed successfully. Jul 08 18:51:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a8dc48a9-7223-4c04-9332-8895e710adbe tempest-GroupsTest-1768282538 None] Update group completed successfully. Jul 08 18:51:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2334a1b9-9e1d-46c3-8ef5-e289ee642e55]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:05 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:51:05 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:06 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 1.228s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:07 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:51:07 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Acquiring lock "cinder-quobyte-3b482672-d87e-4069-921c-c9fa88a38fea" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-3b482672-d87e-4069-921c-c9fa88a38fea" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f0e292-f2f3-4167-bad7-b6403c72ffe7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:07 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea Jul 08 18:51:07 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:07 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 1 in 0.924s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.222s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bac393b2-0a07-4815-b9f4-5c2264334c12', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-b1350920-5dbb-4070-8e4e-9e8315c1241f req-45031eba-1ecc-49ba-b0e8-a8eabf8c44b5 tempest-TestInstancesWithCinderVolumes-997484351 None] attachment_update completed successfully. Jul 08 18:51:08 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea" returned: 0 in 0.862s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:08 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea Jul 08 18:51:08 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:09 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3b482672-d87e-4069-921c-c9fa88a38fea" returned: 0 in 0.686s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-3b482672-d87e-4069-921c-c9fa88a38fea" released by "delete_volume" :: held 1.605s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Acquiring lock "cinder-quobyte-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84810ebe-6486-4e0d-8df3-8478abce80b4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:09 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 Jul 08 18:51:09 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:09 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" returned: 0 in 0.839s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:10 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2 Jul 08 18:51:10 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:10 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" returned: 0 in 0.808s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "cinder-quobyte-4237b4a0-aaf1-40b1-92f6-85dc70cf83a2" released by "delete_volume" :: held 1.732s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Created reservations ['227462fd-c7f4-42bb-9ad3-761d260a2cfb'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:11 devstack cinder-volume[87229]: WARNING cinder.quota [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-524518729 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-524518729, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:51:11 devstack cinder-volume[87229]: WARNING cinder.quota [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-524518729 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-524518729, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Created reservations ['7be495c3-021a-4c1b-a059-c61773cf7d3c', 'e42fbf8b-64cd-4fd6-b64b-b7eedf760332', '0f780083-14fa-4990-a818-ddffe82a6147', 'e3798795-8491-4a4f-a834-e93f33801cdc'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Created reservations ['e2feb716-7418-47ae-99a5-d208d53af4ec', 'ce2372a8-397d-4dee-bfa9-ae2d65a8af6b', 'e43fb621-61c1-4514-b7ca-f52845c30f7b', 'e1b00ccb-870f-4762-aed7-0ca0b4ef4e66'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:11 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:51:11 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:12 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.247s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:12 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:51:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-05896f12-33e9-4512-9992-68a72e282d38 tempest-GroupsTest-1768282538 None] Delete group completed successfully. Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:18 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:51:18 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:19 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.375s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:51:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:51:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:51:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:51:21 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=53,cinder:SELECT=55,cinder:DELETE=3,cinder:INSERT=16 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:51:21 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=97,cinder:INSERT=23,cinder:UPDATE=104,cinder:DELETE=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Flow 'volume_create_manager' (ab29d9a5-3119-4610-9993-ed9dc2da5dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4f0f95-62d7-40fb-8706-62f31228458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4f0f95-62d7-40fb-8706-62f31228458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1810780674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78825c86-f337-43e9-8f64-0d658318fc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14cde97b36460a90cda535484e0e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:22Z,use_quota=True,user_id='ab831bc4259445698b200aa370712282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad51e2a-b843-450e-97a1-8b7f94d63b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad51e2a-b843-450e-97a1-8b7f94d63b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f1af69-d147-45c1-ac28-f87735067e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f1af69-d147-45c1-ac28-f87735067e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78825c86-f337-43e9-8f64-0d658318fc50', 'volume_name': 'volume-78825c86-f337-43e9-8f64-0d658318fc50', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5ef45-6fd2-49ea-96aa-925249643201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5ef45-6fd2-49ea-96aa-925249643201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009f3c7-f61b-4af7-b41e-846b25fae31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Volume 78825c86-f337-43e9-8f64-0d658318fc50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78825c86-f337-43e9-8f64-0d658318fc50', 'volume_size': 1} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1810780674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78825c86-f337-43e9-8f64-0d658318fc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14cde97b36460a90cda535484e0e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:22Z,use_quota=True,user_id='ab831bc4259445698b200aa370712282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Creating volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:51:22 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:51:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:22 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 1073741824 Jul 08 18:51:22 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:24 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 1073741824" returned: 0 in 1.893s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:24 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 Jul 08 18:51:24 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:25 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50" returned: 0 in 1.094s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] <== create_volume: return (3114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.125s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009f3c7-f61b-4af7-b41e-846b25fae31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78825c86-f337-43e9-8f64-0d658318fc50', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473406e3-933b-4fff-a186-41b8db137860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Volume volume-78825c86-f337-43e9-8f64-0d658318fc50 (78825c86-f337-43e9-8f64-0d658318fc50): created successfully Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473406e3-933b-4fff-a186-41b8db137860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Flow 'volume_create_manager' (ab29d9a5-3119-4610-9993-ed9dc2da5dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3b9f3013-4b52-4143-9cc9-201a2adfe747 tempest-SnapshotsActionsTest-1581141848 None] Created volume successfully. Jul 08 18:51:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Creating offline snapshot 1a9ab0d5-5756-4c73-b5af-2d048b19a590 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:51:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa0b42-c738-4b0e-ad56-fc7fe314384e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:28 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 Jul 08 18:51:28 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Flow 'volume_create_manager' (968b902f-ed94-435b-949d-43ffeba6ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60db4b7d-b6d5-4f89-a9b1-c1ab388acf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60db4b7d-b6d5-4f89-a9b1-c1ab388acf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1530303016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092558f9-819b-4b17-a418-084e44dfa8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97dac23299114bc6b408feab1f9846e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:29Z,use_quota=True,user_id='28cf3a6d6f6e457f8c82ab6b183b5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9661b095-425b-4b95-b1e6-c9539883c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9661b095-425b-4b95-b1e6-c9539883c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31074ac-91a5-4365-b35c-1e9973c997a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31074ac-91a5-4365-b35c-1e9973c997a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092558f9-819b-4b17-a418-084e44dfa8c6', 'volume_name': 'volume-092558f9-819b-4b17-a418-084e44dfa8c6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12325d45-feec-4191-93cd-9fd37a5bb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12325d45-feec-4191-93cd-9fd37a5bb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d5c630-6c1e-4818-86a4-2239e27c4d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:28 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Volume 092558f9-819b-4b17-a418-084e44dfa8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092558f9-819b-4b17-a418-084e44dfa8c6', 'volume_size': 1} Jul 08 18:51:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:29 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50" returned: 0 in 1.877s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:29 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 1G Jul 08 18:51:29 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:31 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 1G" returned: 0 in 1.461s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:31 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:31 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:32 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.942s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:32 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 is being set with open permissions: ugo+rw Jul 08 18:51:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:32 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:32 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:32 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.710s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:33 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info Jul 08 18:51:33 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:34 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info" returned: 0 in 1.119s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:34 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info is being set with open permissions: ugo+rw Jul 08 18:51:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:34 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info Jul 08 18:51:34 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:35 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.info" returned: 0 in 1.609s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.964s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.090s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1530303016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092558f9-819b-4b17-a418-084e44dfa8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97dac23299114bc6b408feab1f9846e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:51:29Z,use_quota=True,user_id='28cf3a6d6f6e457f8c82ab6b183b5b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Creating volume 092558f9-819b-4b17-a418-084e44dfa8c6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:51:35 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:51:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:35 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 1073741824 Jul 08 18:51:35 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-925d90f2-f356-4e65-a601-275abe0e78ee tempest-SnapshotsActionsTest-1581141848 None] Create snapshot completed successfully Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:37 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 1073741824" returned: 0 in 1.434s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:37 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 Jul 08 18:51:37 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:37 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6" returned: 0 in 0.627s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.735s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Creating offline snapshot a6bed7ef-7daa-41f2-976b-420d6f577907 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d5c630-6c1e-4818-86a4-2239e27c4d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092558f9-819b-4b17-a418-084e44dfa8c6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9364309d-82bd-4831-aa6a-f6a671333180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a5f863-41c9-48ef-839d-853799730917]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Volume volume-092558f9-819b-4b17-a418-084e44dfa8c6 (092558f9-819b-4b17-a418-084e44dfa8c6): created successfully Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9364309d-82bd-4831-aa6a-f6a671333180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Flow 'volume_create_manager' (968b902f-ed94-435b-949d-43ffeba6ee23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:51:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8cca059d-6e81-4167-9379-1dadd7ce2dc0 tempest-TestMinimumBasicScenario-530451120 None] Created volume successfully. Jul 08 18:51:38 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:38 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:38 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.821s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:38 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 1G Jul 08 18:51:38 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:39 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 1G" returned: 0 in 0.872s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:39 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 Jul 08 18:51:39 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:40 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:40 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 is being set with open permissions: ugo+rw Jul 08 18:51:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:40 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 Jul 08 18:51:40 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:41 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907" returned: 0 in 0.863s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.556s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7290c7cd-746d-42c5-a116-e625b7e424c5 tempest-SnapshotsActionsTest-1581141848 None] Create snapshot completed successfully Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971505a-b922-4714-bc59-e741ea7f2eed]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:41 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 Jul 08 18:51:41 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-a6bed7ef-7daa-41f2-976b-420d6f577907-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-a6bed7ef-7daa-41f2-976b-420d6f577907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:42 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-a6bed7ef-7daa-41f2-976b-420d6f577907" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6" returned: 0 in 0.830s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-a6bed7ef-7daa-41f2-976b-420d6f577907" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Deleting offline snapshot a6bed7ef-7daa-41f2-976b-420d6f577907 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] snapshot_file for this snap is: volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f56fca-fc2d-4a7b-91cc-3a8681e053d4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-092558f9-819b-4b17-a418-084e44dfa8c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '655bc4f0-d5eb-4d9c-a3fd-070045516810', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-c56c4f80-e666-4598-adbc-b211a191f8d0 req-119a3c88-fb04-4bcd-add6-833a7399a2c1 tempest-TestMinimumBasicScenario-530451120 None] attachment_update completed successfully. Jul 08 18:51:42 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 Jul 08 18:51:42 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:43 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907" returned: 0 in 0.898s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[08443e15-a605-49f8-a50c-e1921499f4fc]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:43 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:43 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:45 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 1.512s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:45 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 Jul 08 18:51:45 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:46 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907" returned: 0 in 1.338s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:46 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907 Jul 08 18:51:46 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:47 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.a6bed7ef-7daa-41f2-976b-420d6f577907" returned: 0 in 1.056s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-a6bed7ef-7daa-41f2-976b-420d6f577907" released by "_delete_snapshot" :: held 4.960s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_snapshot" :: held 5.000s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:47 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Created reservations ['44fd9345-c121-408b-9456-bbdc57f37dbf', '617bce66-2cc9-4496-bd21-6663beea21f8', 'ef56c7ac-a442-4355-96f9-dc4b4937d965', '1be431c2-53f1-451f-9ffa-a7a569f7689c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Delete snapshot completed successfully. Jul 08 18:51:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-544828ee-bffb-44ba-affa-2ada883d75a8 tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-a6bed7ef-7daa-41f2-976b-420d6f577907-delete_snapshot" released by "delete_snapshot" :: held 5.183s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Creating offline snapshot c64fb7ca-218e-41cc-a4aa-8e6f835bb7de of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:51:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd826d9-b714-4daa-9f1a-b526b77b6462]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:48 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:48 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:49 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.811s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:49 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de 1G Jul 08 18:51:49 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:50 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de 1G" returned: 0 in 0.979s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:50 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de Jul 08 18:51:50 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:51 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" returned: 0 in 1.208s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:51 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de is being set with open permissions: ugo+rw Jul 08 18:51:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:51 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de Jul 08 18:51:51 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:52 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" returned: 0 in 0.889s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.034s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-18f49854-e932-4022-9a4d-9a848b8ba45f tempest-SnapshotsActionsTest-1581141848 None] Create snapshot completed successfully Jul 08 18:51:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Deleting offline snapshot c64fb7ca-218e-41cc-a4aa-8e6f835bb7de of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] snapshot_file for this snap is: volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc8eb3-3d0d-4b67-b85e-08e4721029c5]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:53 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de Jul 08 18:51:53 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:54 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" returned: 0 in 0.981s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9152d23f-bf2a-4a36-a714-31988dd09391]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:54 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:54 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f428f03-0922-4db1-b07a-66dfdfdd3b6f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:55 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 1.001s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:55 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de Jul 08 18:51:55 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:55 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 Jul 08 18:51:55 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:56 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" returned: 0 in 1.114s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:56 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de Jul 08 18:51:56 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:56 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7" returned: 0 in 1.196s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.256s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:51:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-9d711e41-42ab-4f74-b967-22a2c3992ca7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9c11ba3-3687-4d5c-a3d4-42d9b1b71451', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:51:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-1ef22eed-6149-4ff4-9a01-6e497ce7a627 req-fc268df1-aedd-4f66-b471-1a461bbdfffb tempest-TestInstancesWithCinderVolumes-997484351 None] attachment_update completed successfully. Jul 08 18:51:57 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" returned: 0 in 0.795s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de" released by "_delete_snapshot" :: held 4.009s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_snapshot" :: held 4.040s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:57 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Created reservations ['825077f3-a7b7-4b63-a3d4-e3f7a5c36826', 'cca07c86-e0b1-416f-85d0-8cc3ce56719a', '4fcbeb79-3b19-436b-ab44-218915fc6b49', 'b0ff0969-8757-42c3-adf4-02f86307d959'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:51:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Delete snapshot completed successfully. Jul 08 18:51:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-68def1f2-d724-4226-8f13-5981c922f57d tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-c64fb7ca-218e-41cc-a4aa-8e6f835bb7de-delete_snapshot" released by "delete_snapshot" :: held 4.291s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:51:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:51:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:51:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Creating offline snapshot ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:51:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda79812-3135-4aa7-ad18-74ce17e54dbf]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:51:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:58 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:51:58 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:51:59 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 08 18:51:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.783s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:51:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:51:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:51:59 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 1G Jul 08 18:51:59 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:00 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 1G" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:00 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 Jul 08 18:52:00 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:01 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" returned: 0 in 0.734s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:01 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 is being set with open permissions: ugo+rw Jul 08 18:52:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:01 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 Jul 08 18:52:01 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:01 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" returned: 0 in 0.684s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a06ec56f-fba3-4da5-97fd-8fbcf5423027 tempest-SnapshotsActionsTest-1581141848 None] Create snapshot completed successfully Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Deleting offline snapshot ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] snapshot_file for this snap is: volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[358d8c81-0604-4936-8a07-da6120032352]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:03 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 Jul 08 18:52:03 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:03 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" returned: 0 in 0.811s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fe008-fdff-44c6-9918-8d56f3cd7682]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:04 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:04 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb82f09-0948-4dd3-a729-1fb09debab1c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:04 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 Jul 08 18:52:04 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:04 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.803s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:04 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 Jul 08 18:52:04 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:05 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291" returned: 0 in 0.808s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-b512b345-e102-429f-ba38-cb6b4a71f291', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02ba4664-cccf-4c67-babb-540350d6a056', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:52:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-6725b5ce-805b-4f3a-b61f-aa20b9de2238 req-e086e157-7b80-4be6-a90d-ca782a154ac9 tempest-TestInstancesWithCinderVolumes-997484351 None] attachment_update completed successfully. Jul 08 18:52:05 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" returned: 0 in 0.869s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:05 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5 Jul 08 18:52:05 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:06 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" returned: 0 in 0.794s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5" released by "_delete_snapshot" :: held 3.368s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_snapshot" :: held 3.391s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:06 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Created reservations ['e5d9c1f1-8e7b-4276-a130-e049fe5bf3e4', 'f6f91b59-c658-47c8-9442-88c34265424a', '5beb0d54-d645-41ee-bcb4-ad87fee38f63', 'a50d1f07-4204-4182-915c-8035a22d1395'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Delete snapshot completed successfully. Jul 08 18:52:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-75e4c74f-8f7f-4f58-80a3-b3cfa669152f tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-ff41f2a1-7a98-4dea-bb04-c0f19c9ba4b5-delete_snapshot" released by "delete_snapshot" :: held 3.554s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Creating offline snapshot 40b8d74e-5c41-4791-ab1d-2249c6823a5a of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:52:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37014987-e6f0-4950-83ec-c9610eb37928]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:07 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:07 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:08 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:08 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a 1G Jul 08 18:52:08 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:09 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a 1G" returned: 0 in 1.003s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:09 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a Jul 08 18:52:09 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (45205662-9d74-4e37-bd7d-0305ef062306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32794f2a-dca0-4e23-9b59-3c8e12e9784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32794f2a-dca0-4e23-9b59-3c8e12e9784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1700609333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5a9332-b669-469c-9677-775a9fcc3cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:10Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d547b1-9ff0-447d-833c-3046831600ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d547b1-9ff0-447d-833c-3046831600ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c9a2af-7761-49c5-a84e-e44a926c7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c9a2af-7761-49c5-a84e-e44a926c7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5a9332-b669-469c-9677-775a9fcc3cd1', 'volume_name': 'volume-0e5a9332-b669-469c-9677-775a9fcc3cd1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f44cc6e-3058-41fa-bd17-1d40a36abfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f44cc6e-3058-41fa-bd17-1d40a36abfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a3a53-7851-45e3-8966-4de9c1947664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Volume 0e5a9332-b669-469c-9677-775a9fcc3cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5a9332-b669-469c-9677-775a9fcc3cd1', 'volume_size': 1} Jul 08 18:52:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:10 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:10 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a is being set with open permissions: ugo+rw Jul 08 18:52:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:10 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a Jul 08 18:52:10 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:11 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1700609333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5a9332-b669-469c-9677-775a9fcc3cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:10Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Creating volume 0e5a9332-b669-469c-9677-775a9fcc3cd1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:52:11 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:52:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:11 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 1073741824 Jul 08 18:52:11 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-30959d9a-5150-4ca1-8963-e853b64c4ebc tempest-SnapshotsActionsTest-1581141848 None] Create snapshot completed successfully Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-40b8d74e-5c41-4791-ab1d-2249c6823a5a-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-40b8d74e-5c41-4791-ab1d-2249c6823a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:12 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 1073741824" returned: 0 in 1.028s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Acquiring lock "cinder-quobyte-40b8d74e-5c41-4791-ab1d-2249c6823a5a" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-40b8d74e-5c41-4791-ab1d-2249c6823a5a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Deleting offline snapshot 40b8d74e-5c41-4791-ab1d-2249c6823a5a of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] snapshot_file for this snap is: volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[779d05f4-26cf-4463-b2e0-adfae2f44d1c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:12 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 Jul 08 18:52:12 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:12 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a Jul 08 18:52:12 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:13 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1" returned: 0 in 0.902s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a3a53-7851-45e3-8966-4de9c1947664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5a9332-b669-469c-9677-775a9fcc3cd1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6d6368-0088-4e56-9c1e-c424adb9c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Volume volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 (0e5a9332-b669-469c-9677-775a9fcc3cd1): created successfully Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6d6368-0088-4e56-9c1e-c424adb9c581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (45205662-9d74-4e37-bd7d-0305ef062306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c7cb0d5f-a844-41eb-8c3f-e6e6149e8642 tempest-AttachVolumeTestJSON-325360765 None] Created volume successfully. Jul 08 18:52:13 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a" returned: 0 in 1.135s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[936ba36b-9be8-47f6-a6d3-bb74bfdb926e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:13 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:13 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:14 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.859s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:14 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a Jul 08 18:52:14 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:15 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a" returned: 0 in 0.943s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:15 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a Jul 08 18:52:15 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-fec18fa9-66bd-4ef7-9f8c-e7b9319707dc req-b39202e4-36fe-44a7-9093-2e10ffc4f6c1 tempest-TestInstancesWithCinderVolumes-997484351 None] Terminate volume connection completed successfully. Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-fec18fa9-66bd-4ef7-9f8c-e7b9319707dc req-b39202e4-36fe-44a7-9093-2e10ffc4f6c1 tempest-TestInstancesWithCinderVolumes-997484351 None] Deleting attachment e9c11ba3-3687-4d5c-a3d4-42d9b1b71451. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:15 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.40b8d74e-5c41-4791-ab1d-2249c6823a5a" returned: 0 in 0.713s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-40b8d74e-5c41-4791-ab1d-2249c6823a5a" released by "_delete_snapshot" :: held 3.760s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_snapshot" :: held 3.792s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:15 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Created reservations ['7a7995cf-b33a-48c2-ac1c-86d437c60927', '73001589-f5bc-48b7-b423-70438e40a16a', '859fbacf-baee-4809-b939-22bf6d2f071c', '128a078d-6a13-4520-af25-2aa5a0637bdc'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Delete snapshot completed successfully. Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae58471e-2855-4a88-8fdb-0c21889314ab tempest-SnapshotsActionsTest-2041123323 None] Lock "cinder-40b8d74e-5c41-4791-ab1d-2249c6823a5a-delete_snapshot" released by "delete_snapshot" :: held 3.951s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "cinder-1a9ab0d5-5756-4c73-b5af-2d048b19a590-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-1a9ab0d5-5756-4c73-b5af-2d048b19a590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "cinder-quobyte-1a9ab0d5-5756-4c73-b5af-2d048b19a590" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-1a9ab0d5-5756-4c73-b5af-2d048b19a590" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Deleting offline snapshot 1a9ab0d5-5756-4c73-b5af-2d048b19a590 of volume 78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] snapshot_file for this snap is: volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc106915-b258-49ef-9762-c1b7c33c78ab]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:16 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:16 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d37e2a3-722a-4410-a254-e154d44aa606]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:17 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 Jul 08 18:52:17 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:17 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78825c86-f337-43e9-8f64-0d658318fc50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-9d711e41-42ab-4f74-b967-22a2c3992ca7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c253d1-8504-443a-85ce-c82d664c9989]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-9d711e41-42ab-4f74-b967-22a2c3992ca7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-quobyte-9d711e41-42ab-4f74-b967-22a2c3992ca7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-9d711e41-42ab-4f74-b967-22a2c3992ca7" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df01acb-16af-457d-bf0d-abc3ec9c0a1b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:17 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 Jul 08 18:52:17 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:18 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 Jul 08 18:52:18 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:18 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:18 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:18 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1" returned: 0 in 1.091s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.111s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-0e5a9332-b669-469c-9677-775a9fcc3cd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4b0dd6e-f771-47b0-b5e2-1611ca21a61c', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:52:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-509f2f1b-6b71-4186-bec5-3cf5ac802da3 req-6f3a4341-cc2c-41a0-aac6-3dc05525fa9d tempest-AttachVolumeTestJSON-325360765 None] attachment_update completed successfully. Jul 08 18:52:19 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7" returned: 0 in 1.126s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:19 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7 Jul 08 18:52:19 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:19 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50" returned: 0 in 1.619s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:19 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:19 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:19 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.338s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:52:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:52:20 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9d711e41-42ab-4f74-b967-22a2c3992ca7" returned: 0 in 1.014s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-9d711e41-42ab-4f74-b967-22a2c3992ca7" released by "delete_volume" :: held 2.202s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:20 devstack cinder-volume[87229]: WARNING cinder.quota [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236165476-624793720 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236165476-624793720, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:20 devstack cinder-volume[87229]: WARNING cinder.quota [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236165476-624793720 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236165476-624793720, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Created reservations ['19777bd5-0ed4-4a92-bf43-f7efc1f5126d', '09ea7b67-90a3-42f0-a238-98496d1b7992', 'bf92f590-75c8-48e7-887e-55585f25a683', '0ebaf18b-bd7b-4c88-8238-b1bf33836785'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:20 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:20 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:20 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 1.126s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:20 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590 Jul 08 18:52:20 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:20 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.791s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:20 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Deleted volume successfully. Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a84de502-9ce7-4af3-baeb-711aa05b945d tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-9d711e41-42ab-4f74-b967-22a2c3992ca7-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:21 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50.1a9ab0d5-5756-4c73-b5af-2d048b19a590" returned: 0 in 0.811s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-1a9ab0d5-5756-4c73-b5af-2d048b19a590" released by "_delete_snapshot" :: held 4.547s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_snapshot" :: held 4.577s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Created reservations ['d8261616-3ef3-4219-9611-3f203bb1a71c', 'a92c9d55-49c0-4db9-9042-1c67b2d7e165', '1108c847-c8eb-4572-b7c4-ec2715ac30e4', 'ee1c9785-3555-438b-a503-a677d549d1f4'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Delete snapshot completed successfully. Jul 08 18:52:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67acd960-bf55-4aef-a68f-2e006b363e78 tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-1a9ab0d5-5756-4c73-b5af-2d048b19a590-delete_snapshot" released by "delete_snapshot" :: held 4.762s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "cinder-78825c86-f337-43e9-8f64-0d658318fc50-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-78825c86-f337-43e9-8f64-0d658318fc50-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=80,cinder:UPDATE=64,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=49,cinder:SELECT=63,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c327727-2e16-46a3-9aaf-5d0a56441e96]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:22 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 Jul 08 18:52:22 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:23 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:23 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50 Jul 08 18:52:23 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-2a9395f2-15f8-4144-b19e-c32407c5f33c req-d3128acb-a364-4016-bc6c-ee5975f3bd9c tempest-TestInstancesWithCinderVolumes-997484351 None] Terminate volume connection completed successfully. Jul 08 18:52:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-2a9395f2-15f8-4144-b19e-c32407c5f33c req-d3128acb-a364-4016-bc6c-ee5975f3bd9c tempest-TestInstancesWithCinderVolumes-997484351 None] Deleting attachment 02ba4664-cccf-4c67-babb-540350d6a056. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:23 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-78825c86-f337-43e9-8f64-0d658318fc50" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-quobyte-78825c86-f337-43e9-8f64-0d658318fc50" released by "delete_volume" :: held 1.616s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Created reservations ['27ae253c-1004-40d2-9330-617684e5cf70', '32567af7-ed8b-45e4-8e98-e6e5ff4c78c6', '9198855c-ecec-4834-9c36-0142b59f16b4', 'a8cc3bd0-aa80-49a3-b732-27c4c01407a4'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:24 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:24 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (2746a9c6-df61-4b66-9b4f-f3c1acf9d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6310bae2-f6f3-4935-8917-54b8f1df9517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6310bae2-f6f3-4935-8917-54b8f1df9517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1760148037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401aef7c-2551-4f2b-9f29-772be71a8341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:24Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17015266-cf23-40cb-bfb7-75b61293d55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17015266-cf23-40cb-bfb7-75b61293d55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5c741e-0300-4ca2-9f64-deb7e0bd32d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5c741e-0300-4ca2-9f64-deb7e0bd32d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401aef7c-2551-4f2b-9f29-772be71a8341', 'volume_name': 'volume-401aef7c-2551-4f2b-9f29-772be71a8341', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f620c4ed-eba8-46f3-8c27-aa93bcfdfd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f620c4ed-eba8-46f3-8c27-aa93bcfdfd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f41fa5-f5ff-4a43-9bd2-cb374fedb0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Volume 401aef7c-2551-4f2b-9f29-772be71a8341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401aef7c-2551-4f2b-9f29-772be71a8341', 'volume_size': 1} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1760148037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401aef7c-2551-4f2b-9f29-772be71a8341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3a5257a202478b8775df1f1d2abf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:24Z,use_quota=True,user_id='b44a48d4c4364c98837d902f7bea4652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Creating volume 401aef7c-2551-4f2b-9f29-772be71a8341 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:52:24 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:52:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:24 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 1073741824 Jul 08 18:52:24 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:25 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.025s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Deleted volume successfully. Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-95c1cc3f-edee-4c6b-8566-e98d6c42581b tempest-SnapshotsActionsTest-1581141848 None] Lock "cinder-78825c86-f337-43e9-8f64-0d658318fc50-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-b512b345-e102-429f-ba38-cb6b4a71f291-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-b512b345-e102-429f-ba38-cb6b4a71f291-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-quobyte-b512b345-e102-429f-ba38-cb6b4a71f291" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-b512b345-e102-429f-ba38-cb6b4a71f291" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921a91a-e56a-448e-a88f-5d0be8dc32d6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:25 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 Jul 08 18:52:25 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:25 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 1073741824" returned: 0 in 1.391s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:26 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 Jul 08 18:52:26 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:26 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291" returned: 0 in 1.128s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:26 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291 Jul 08 18:52:26 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:27 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341" returned: 0 in 1.155s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.625s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f41fa5-f5ff-4a43-9bd2-cb374fedb0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401aef7c-2551-4f2b-9f29-772be71a8341', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70cefab5-58b3-4de4-a2d3-750bd67bc946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:27 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Volume volume-401aef7c-2551-4f2b-9f29-772be71a8341 (401aef7c-2551-4f2b-9f29-772be71a8341): created successfully Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70cefab5-58b3-4de4-a2d3-750bd67bc946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Flow 'volume_create_manager' (2746a9c6-df61-4b66-9b4f-f3c1acf9d1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6a43a31e-1147-4035-82ac-46633cbc89e8 tempest-AttachVolumeTestJSON-325360765 None] Created volume successfully. Jul 08 18:52:27 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b512b345-e102-429f-ba38-cb6b4a71f291" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-b512b345-e102-429f-ba38-cb6b4a71f291" released by "delete_volume" :: held 1.954s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:27 devstack cinder-volume[87229]: WARNING cinder.quota [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098077325-722123401 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098077325-722123401, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:27 devstack cinder-volume[87229]: WARNING cinder.quota [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098077325-722123401 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098077325-722123401, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Created reservations ['3940c242-3010-4979-9a9e-ac32fce32588', 'a33bf3b1-b936-426a-a934-2c7b7a344dd8', '073806fd-0fd0-4155-8b56-a949bb54e254', 'a57e4980-8bc2-496b-8c9e-97275e438e66'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:27 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:27 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:28 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:28 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Deleted volume successfully. Jul 08 18:52:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-60596322-236f-424a-abbc-7b824f0e5f89 tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-b512b345-e102-429f-ba38-cb6b4a71f291-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c1a23-472b-4c03-a454-8991861f5ea8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:31 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 Jul 08 18:52:31 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:31 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341" returned: 0 in 0.894s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-401aef7c-2551-4f2b-9f29-772be71a8341', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc9937cd-7e18-4815-8648-7b48c65e014b', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:52:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-e4b83954-6f0e-42a2-8a77-644692a5384f req-7bea16c9-34fd-44ad-a53f-159f166ba480 tempest-AttachVolumeTestJSON-325360765 None] attachment_update completed successfully. Jul 08 18:52:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-2f1623a6-5c55-4150-aa67-2390d3ce93a5 req-40e208e2-c101-4c8b-845a-bfee2decf212 tempest-TestInstancesWithCinderVolumes-997484351 None] Terminate volume connection completed successfully. Jul 08 18:52:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-2f1623a6-5c55-4150-aa67-2390d3ce93a5 req-40e208e2-c101-4c8b-845a-bfee2decf212 tempest-TestInstancesWithCinderVolumes-997484351 None] Deleting attachment bac393b2-0a07-4815-b9f4-5c2264334c12. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "cinder-quobyte-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" acquired by "delete_volume" :: waited 0.046s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219e10f-b8d7-4a5f-8db2-218833bb24ed]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:37 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:52:37 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:38 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 1.153s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:39 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:52:39 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-33c43f18-def4-4647-a3ca-ba6065cdc1e8 req-48d53c2d-5e08-4454-961c-909cd82ca053 tempest-AttachVolumeTestJSON-325360765 None] Terminate volume connection completed successfully. Jul 08 18:52:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-33c43f18-def4-4647-a3ca-ba6065cdc1e8 req-48d53c2d-5e08-4454-961c-909cd82ca053 tempest-AttachVolumeTestJSON-325360765 None] Deleting attachment f4b0dd6e-f771-47b0-b5e2-1611ca21a61c. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:39 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 1 in 0.887s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:52:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:39 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1 Jul 08 18:52:39 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-042d888b-938a-4406-b557-ea0274278d45 req-47b09281-e27d-4809-a0f9-d0db9199b2a1 tempest-TestMinimumBasicScenario-530451120 None] Terminate volume connection completed successfully. Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-042d888b-938a-4406-b557-ea0274278d45 req-47b09281-e27d-4809-a0f9-d0db9199b2a1 tempest-TestMinimumBasicScenario-530451120 None] Deleting attachment 655bc4f0-d5eb-4d9c-a3fd-070045516810. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:40 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" returned: 0 in 0.956s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-quobyte-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1" released by "delete_volume" :: held 3.089s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:40 devstack cinder-volume[87229]: WARNING cinder.quota [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190153981-1732775645 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190153981-1732775645, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:40 devstack cinder-volume[87229]: WARNING cinder.quota [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190153981-1732775645 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-190153981-1732775645, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Created reservations ['4095a3ae-c363-43c1-b089-9c6f62367db1', 'bb6fc895-57bf-4c3b-80f2-d0e097c147ca', 'd3456061-78b7-4a42-a598-709a366c2468', '4c23283b-bd7a-409c-b9bb-096ca0357580'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:41 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:41 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:41 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.834s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:41 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Deleted volume successfully. Jul 08 18:52:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9b771b04-3c50-4f52-945d-68c11965cf1c tempest-TestInstancesWithCinderVolumes-997484351 None] Lock "cinder-fbe4c1e5-4f6a-4a07-84e3-b39c6c800da1-delete_volume" released by "delete_volume" :: held 4.250s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-53696422-ee26-46af-aef2-4df86db75c3e req-e5197161-f00f-4744-87d1-088827908059 tempest-AttachVolumeTestJSON-325360765 None] Terminate volume connection completed successfully. Jul 08 18:52:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-53696422-ee26-46af-aef2-4df86db75c3e req-e5197161-f00f-4744-87d1-088827908059 tempest-AttachVolumeTestJSON-325360765 None] Deleting attachment cc9937cd-7e18-4815-8648-7b48c65e014b. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:52:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "cinder-092558f9-819b-4b17-a418-084e44dfa8c6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "cinder-092558f9-819b-4b17-a418-084e44dfa8c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "cinder-quobyte-092558f9-819b-4b17-a418-084e44dfa8c6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "cinder-quobyte-092558f9-819b-4b17-a418-084e44dfa8c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e5eb43-9ebe-4aa0-b3cb-4e8d163eeeb8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:43 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 Jul 08 18:52:43 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:43 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6" returned: 0 in 0.939s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:44 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6 Jul 08 18:52:44 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:44 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-092558f9-819b-4b17-a418-084e44dfa8c6" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "cinder-quobyte-092558f9-819b-4b17-a418-084e44dfa8c6" released by "delete_volume" :: held 1.821s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Created reservations ['5c5dc3bb-8680-4207-be50-16dffd04a7c6', 'cde63018-8190-4216-9d34-f48b22c6238a', '531529c9-3c98-4ca8-a6ee-7d290c7656f8', '253f6fee-60ec-4064-a778-1a8a3630eeb1'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:45 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:45 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:46 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.055s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:46 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Deleted volume successfully. Jul 08 18:52:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1223796-a91d-44d2-8f91-294bea97332f tempest-TestMinimumBasicScenario-530451120 None] Lock "cinder-092558f9-819b-4b17-a418-084e44dfa8c6-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Flow 'volume_create_manager' (a789b2ed-41d2-498f-bfeb-95a1af483b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18454078-af9f-4a91-8bd9-e0bb552de64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18454078-af9f-4a91-8bd9-e0bb552de64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1054383592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37c0e55-7301-49c4-a200-d7bd81449fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b503547d4a44449878b241b1e04ca5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:49Z,use_quota=True,user_id='dae8053c33414916916c6ad4b60e8c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb18a1bc-6523-486c-9b72-9e4046dd39d1),volume_type_id=cb18a1bc-6523-486c-9b72-9e4046dd39d1)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e88cd-3131-4cec-967b-69b39c403a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e88cd-3131-4cec-967b-69b39c403a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2e72c-f603-4f15-87b3-ee5626d9da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2e72c-f603-4f15-87b3-ee5626d9da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37c0e55-7301-49c4-a200-d7bd81449fa8', 'volume_name': 'volume-a37c0e55-7301-49c4-a200-d7bd81449fa8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867f41ff-b96b-49c4-ac67-45c861623857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867f41ff-b96b-49c4-ac67-45c861623857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302a28ec-420a-4623-8424-1876f5441dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:49 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Volume a37c0e55-7301-49c4-a200-d7bd81449fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37c0e55-7301-49c4-a200-d7bd81449fa8', 'volume_size': 1} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1054383592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37c0e55-7301-49c4-a200-d7bd81449fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b503547d4a44449878b241b1e04ca5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:52:49Z,use_quota=True,user_id='dae8053c33414916916c6ad4b60e8c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb18a1bc-6523-486c-9b72-9e4046dd39d1),volume_type_id=cb18a1bc-6523-486c-9b72-9e4046dd39d1)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Creating volume a37c0e55-7301-49c4-a200-d7bd81449fa8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:52:49 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:52:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:49 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 1073741824 Jul 08 18:52:49 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:50 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 1073741824" returned: 0 in 0.982s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:50 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 Jul 08 18:52:50 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:51 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8" returned: 0 in 0.692s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302a28ec-420a-4623-8424-1876f5441dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37c0e55-7301-49c4-a200-d7bd81449fa8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43f6fed-27cd-4349-bb29-463283bb8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:52:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Volume volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 (a37c0e55-7301-49c4-a200-d7bd81449fa8): created successfully Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43f6fed-27cd-4349-bb29-463283bb8373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Flow 'volume_create_manager' (a789b2ed-41d2-498f-bfeb-95a1af483b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:52:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c5ce13e4-c29e-4fa1-a557-f940ee043bf0 tempest-VolumeTypesAccessTest-756178245 None] Created volume successfully. Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Acquiring lock "cinder-a37c0e55-7301-49c4-a200-d7bd81449fa8-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "cinder-a37c0e55-7301-49c4-a200-d7bd81449fa8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Acquiring lock "cinder-quobyte-a37c0e55-7301-49c4-a200-d7bd81449fa8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "cinder-quobyte-a37c0e55-7301-49c4-a200-d7bd81449fa8" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53671cb-5b92-4de7-bbe4-96cb19fed1ef]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:51 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 Jul 08 18:52:51 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:52 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8" returned: 0 in 1.069s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:52 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8 Jul 08 18:52:52 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-401aef7c-2551-4f2b-9f29-772be71a8341-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-401aef7c-2551-4f2b-9f29-772be71a8341-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-quobyte-401aef7c-2551-4f2b-9f29-772be71a8341" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-401aef7c-2551-4f2b-9f29-772be71a8341" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9afae33-d639-4704-9862-cf8f4f1a552f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:53 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 Jul 08 18:52:53 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:53 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a37c0e55-7301-49c4-a200-d7bd81449fa8" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "cinder-quobyte-a37c0e55-7301-49c4-a200-d7bd81449fa8" released by "delete_volume" :: held 1.930s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:53 devstack cinder-volume[87229]: WARNING cinder.quota [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1959354511 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1959354511, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:53 devstack cinder-volume[87229]: WARNING cinder.quota [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1959354511 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1959354511, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Created reservations ['6af60a5f-eda2-4d8e-93ea-6550c3f4372d', '9d7da325-5363-44ac-b943-84638e980f9c', '701e1d63-9069-4463-bfbe-0c2f94d8a4b5', '86b38ce0-2a67-430f-b690-bf82b4f45208'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:53 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:53 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:54 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341" returned: 0 in 1.031s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:54 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341 Jul 08 18:52:54 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:54 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:54 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Deleted volume successfully. Jul 08 18:52:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-12f640a9-d36f-4323-8b70-216f30a6dcd8 tempest-VolumeTypesAccessTest-756178245 None] Lock "cinder-a37c0e55-7301-49c4-a200-d7bd81449fa8-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:55 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-401aef7c-2551-4f2b-9f29-772be71a8341" returned: 0 in 0.893s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-401aef7c-2551-4f2b-9f29-772be71a8341" released by "delete_volume" :: held 1.978s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Created reservations ['cd9abc97-8398-43c9-b4fc-a3dd03abb295', 'dd73c710-f80f-4736-9e3e-2de1369bd097', '9b0a799b-46ac-40cb-bebc-f0ace6f56165', 'f5f00a55-282b-465a-afae-adc659fb007d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:55 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:55 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-0e5a9332-b669-469c-9677-775a9fcc3cd1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-0e5a9332-b669-469c-9677-775a9fcc3cd1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-quobyte-0e5a9332-b669-469c-9677-775a9fcc3cd1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-0e5a9332-b669-469c-9677-775a9fcc3cd1" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c2536-8f75-4d27-881c-0ff520077536]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:56 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 Jul 08 18:52:56 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:56 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:56 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Deleted volume successfully. Jul 08 18:52:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d489917f-a8c6-41d8-ad48-a8cdb573e980 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-401aef7c-2551-4f2b-9f29-772be71a8341-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:57 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1" returned: 0 in 1.224s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:57 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1 Jul 08 18:52:57 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:57 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0e5a9332-b669-469c-9677-775a9fcc3cd1" returned: 0 in 0.784s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-0e5a9332-b669-469c-9677-775a9fcc3cd1" released by "delete_volume" :: held 2.095s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Created reservations ['3aa71cf1-a92b-44d5-a12f-30e720f066c8', 'a44e995a-eb5d-454b-9c13-608250c4ed36', 'fe275dd1-d5b9-433a-b700-2ed0391bfca3', '6ce8d9c8-8f3e-4b81-b460-6cdd5758dfd3'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:58 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:52:58 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:52:58 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.759s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:52:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Deleted volume successfully. Jul 08 18:52:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7a350eb4-a918-4a68-8bc4-c46dbe3c1822 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-0e5a9332-b669-469c-9677-775a9fcc3cd1-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-e9cb0746-aeed-4cfc-829f-ae7fc92499a9-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-e9cb0746-aeed-4cfc-829f-ae7fc92499a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "cinder-quobyte-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d3c72-a51b-4016-9d25-dbbb44a7febd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:52:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:52:59 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 Jul 08 18:52:59 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:00 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" returned: 0 in 0.911s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:00 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9 Jul 08 18:53:00 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:01 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" returned: 0 in 0.733s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-quobyte-e9cb0746-aeed-4cfc-829f-ae7fc92499a9" released by "delete_volume" :: held 1.698s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Created reservations ['91a8ee6a-d64c-483a-a280-8bb1e6403743', '65b5b423-81cf-41b8-9801-461408f9037c', '59042a36-cebb-4d94-933c-05aeb44de66f', 'd149eddd-51a2-4d92-ba67-2dfa7f40a5f9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:01 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:01 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:01 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.710s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:01 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:02 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Deleted volume successfully. Jul 08 18:53:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f5acf67c-c665-4351-876c-1d8e24d6d9f5 tempest-AttachVolumeTestJSON-325360765 None] Lock "cinder-e9cb0746-aeed-4cfc-829f-ae7fc92499a9-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:11 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=49,cinder:INSERT=19,cinder:UPDATE=71,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:12 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=60,cinder:INSERT=15,cinder:UPDATE=72,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Flow 'volume_create_manager' (a6a5bbe3-b6a0-4926-a5a4-1874f56b2784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30138f1e-8c4a-4001-afd6-600af6e5d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30138f1e-8c4a-4001-afd6-600af6e5d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1042426865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b8647d-f0b4-44d5-a684-78e2ab7e41c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdff04ffaa99471a8830b551716d6fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:13Z,use_quota=True,user_id='001a41b4646b4e929783c6f3147f4953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d8c86-3b99-4613-b8e5-02f8b67e174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d8c86-3b99-4613-b8e5-02f8b67e174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd84310-70e6-4caf-9a22-be31e6de6d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd84310-70e6-4caf-9a22-be31e6de6d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b8647d-f0b4-44d5-a684-78e2ab7e41c6', 'volume_name': 'volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f5ad56-d2eb-4c52-afd8-8185df67b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f5ad56-d2eb-4c52-afd8-8185df67b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f19a7-1655-4e8e-9b28-05b418f66ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Volume 33b8647d-f0b4-44d5-a684-78e2ab7e41c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6', 'volume_size': 1} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1042426865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b8647d-f0b4-44d5-a684-78e2ab7e41c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdff04ffaa99471a8830b551716d6fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:13Z,use_quota=True,user_id='001a41b4646b4e929783c6f3147f4953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Creating volume 33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:13 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:53:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:13 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 1073741824 Jul 08 18:53:13 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (9c913165-d7ad-4c13-adad-a6d4105758e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbea0add-aa2f-4bbe-9357-923cec0f4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:14 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbea0add-aa2f-4bbe-9357-923cec0f4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-384680844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68052560-c880-4efb-b5ec-d94f84ddb131,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:15Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59ef51d-5595-42c8-b0f7-62fd63460196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59ef51d-5595-42c8-b0f7-62fd63460196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d53931d-b0e1-4743-9407-5d0220befbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d53931d-b0e1-4743-9407-5d0220befbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68052560-c880-4efb-b5ec-d94f84ddb131', 'volume_name': 'volume-68052560-c880-4efb-b5ec-d94f84ddb131', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a524e80-6add-4de5-9779-47993f59324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a524e80-6add-4de5-9779-47993f59324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6754af26-de72-451d-a611-ef9dd90553a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Volume 68052560-c880-4efb-b5ec-d94f84ddb131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68052560-c880-4efb-b5ec-d94f84ddb131', 'volume_size': 1} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 1073741824" returned: 0 in 1.365s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:14 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 Jul 08 18:53:14 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:15 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-384680844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68052560-c880-4efb-b5ec-d94f84ddb131,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:15Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Creating volume 68052560-c880-4efb-b5ec-d94f84ddb131 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:15 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f19a7-1655-4e8e-9b28-05b418f66ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:15 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 1073741824 Jul 08 18:53:15 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e340d5-0041-4281-b156-3868022e03a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Volume volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 (33b8647d-f0b4-44d5-a684-78e2ab7e41c6): created successfully Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e340d5-0041-4281-b156-3868022e03a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Flow 'volume_create_manager' (a6a5bbe3-b6a0-4926-a5a4-1874f56b2784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c9d7c57f-6651-4063-b03c-544f2f3ae6d7 tempest-SnapshotMetadataTestJSON-65013989 None] Created volume successfully. Jul 08 18:53:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:16 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 1073741824" returned: 0 in 1.249s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:16 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 Jul 08 18:53:16 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:17 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.965s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Creating offline snapshot 0d9641f0-2a08-4138-9ac4-730ca6c351c7 of volume 33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6754af26-de72-451d-a611-ef9dd90553a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68052560-c880-4efb-b5ec-d94f84ddb131', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc5b85a-e2ec-4375-90f6-a8d088af9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df891b4-04f3-425f-9a6a-091ee54524aa]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Volume volume-68052560-c880-4efb-b5ec-d94f84ddb131 (68052560-c880-4efb-b5ec-d94f84ddb131): created successfully Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc5b85a-e2ec-4375-90f6-a8d088af9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (9c913165-d7ad-4c13-adad-a6d4105758e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4d1c1b76-687a-4b8a-a3e4-9146b1022cdb tempest-VolumesTestJSON-1495306529 None] Created volume successfully. Jul 08 18:53:17 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 Jul 08 18:53:17 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:18 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:18 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:18 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" returned: 0 in 0.959s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:18 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 1G Jul 08 18:53:18 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:19 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.991s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (429cc746-ed84-42ab-a210-52ef2ae1a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe7a2fe-fedc-4ace-93ec-2a1c9a7d556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:19 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe7a2fe-fedc-4ace-93ec-2a1c9a7d556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1256350286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e4479b-38bf-4c35-bd87-987344d54882,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:20Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ea206-2cfb-4e5e-86f2-2cf83a9410b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ea206-2cfb-4e5e-86f2-2cf83a9410b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2e4689-79f7-4041-be5c-5e6dd9fd3b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2e4689-79f7-4041-be5c-5e6dd9fd3b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e4479b-38bf-4c35-bd87-987344d54882', 'volume_name': 'volume-28e4479b-38bf-4c35-bd87-987344d54882', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215c8d49-2180-425d-a305-27da58954c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215c8d49-2180-425d-a305-27da58954c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6980499-4551-4589-b00f-317202d44aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:19 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Volume 28e4479b-38bf-4c35-bd87-987344d54882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e4479b-38bf-4c35-bd87-987344d54882', 'volume_size': 1} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 1G" returned: 0 in 1.228s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:19 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 Jul 08 18:53:19 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:20 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7" returned: 0 in 0.887s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:20 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 is being set with open permissions: ugo+rw Jul 08 18:53:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:20 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 Jul 08 18:53:20 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:21 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7" returned: 0 in 0.686s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:21 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info Jul 08 18:53:21 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:22 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info" returned: 0 in 0.760s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:22 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info is being set with open permissions: ugo+rw Jul 08 18:53:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:22 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info Jul 08 18:53:22 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:23 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.info" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.246s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1256350286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e4479b-38bf-4c35-bd87-987344d54882,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:20Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Creating volume 28e4479b-38bf-4c35-bd87-987344d54882 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:23 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:53:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:23 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 1073741824 Jul 08 18:53:23 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a3e6bd20-db7a-42cb-b951-76425ae6534e tempest-SnapshotMetadataTestJSON-65013989 None] Create snapshot completed successfully Jul 08 18:53:24 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 1073741824" returned: 0 in 1.107s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:24 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 Jul 08 18:53:24 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "cinder-0d9641f0-2a08-4138-9ac4-730ca6c351c7-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-0d9641f0-2a08-4138-9ac4-730ca6c351c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "cinder-quobyte-0d9641f0-2a08-4138-9ac4-730ca6c351c7" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-0d9641f0-2a08-4138-9ac4-730ca6c351c7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Deleting offline snapshot 0d9641f0-2a08-4138-9ac4-730ca6c351c7 of volume 33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] snapshot_file for this snap is: volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[778030f9-6d0c-4ee1-9f7e-adadd681a1a0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:25 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 Jul 08 18:53:25 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:25 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882" returned: 0 in 1.086s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6980499-4551-4589-b00f-317202d44aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e4479b-38bf-4c35-bd87-987344d54882', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1004e3a3-e120-422e-931d-81a5dbe2225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Volume volume-28e4479b-38bf-4c35-bd87-987344d54882 (28e4479b-38bf-4c35-bd87-987344d54882): created successfully Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1004e3a3-e120-422e-931d-81a5dbe2225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (429cc746-ed84-42ab-a210-52ef2ae1a930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9f7def8b-0b84-458b-89a1-b53d338a6b6b tempest-VolumesTestJSON-1495306529 None] Created volume successfully. Jul 08 18:53:26 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:53:26 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0063d33-fd03-4aaf-8a42-9a59fee24093]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:26 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 Jul 08 18:53:26 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (3eee0dab-8c3f-4330-9f2a-ab8dab12bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb30e85-f1b8-4155-bbd6-6df4d30ef9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb30e85-f1b8-4155-bbd6-6df4d30ef9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585481495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23416b1-21bf-47f2-b663-4c88ee69251e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:27Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90e46c1-5582-4c74-8782-738ded87a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90e46c1-5582-4c74-8782-738ded87a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b34d63-4495-4a41-a3a8-24c56bbd7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b34d63-4495-4a41-a3a8-24c56bbd7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23416b1-21bf-47f2-b663-4c88ee69251e', 'volume_name': 'volume-e23416b1-21bf-47f2-b663-4c88ee69251e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b3517-d264-4bb9-b3a5-7d9f917d20bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23b3517-d264-4bb9-b3a5-7d9f917d20bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033eb6e4-66b6-4a71-b9ec-b1817217a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:27 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Volume e23416b1-21bf-47f2-b663-4c88ee69251e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23416b1-21bf-47f2-b663-4c88ee69251e', 'volume_size': 1} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585481495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23416b1-21bf-47f2-b663-4c88ee69251e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a090cfd2556747f7b5f2465299e34025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:27Z,use_quota=True,user_id='3c950dc9269b4f69837591ec95ba8f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Creating volume e23416b1-21bf-47f2-b663-4c88ee69251e {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:27 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:27 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e 1073741824 Jul 08 18:53:27 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:27 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" returned: 0 in 1.124s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:27 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 Jul 08 18:53:27 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:28 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7" returned: 0 in 1.041s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:28 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7 Jul 08 18:53:28 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:28 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e 1073741824" returned: 0 in 1.185s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:28 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e Jul 08 18:53:28 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:29 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e" returned: 0 in 0.787s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033eb6e4-66b6-4a71-b9ec-b1817217a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23416b1-21bf-47f2-b663-4c88ee69251e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de327c5f-2304-403e-b00b-a59ee609ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:29 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Volume volume-e23416b1-21bf-47f2-b663-4c88ee69251e (e23416b1-21bf-47f2-b663-4c88ee69251e): created successfully Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de327c5f-2304-403e-b00b-a59ee609ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Flow 'volume_create_manager' (3eee0dab-8c3f-4330-9f2a-ab8dab12bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:29 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-999115b8-7ae7-45c3-8429-46e4b000209f tempest-VolumesTestJSON-1495306529 None] Created volume successfully. Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6.0d9641f0-2a08-4138-9ac4-730ca6c351c7" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-0d9641f0-2a08-4138-9ac4-730ca6c351c7" released by "_delete_snapshot" :: held 4.210s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" released by "delete_snapshot" :: held 4.239s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Created reservations ['43c0ac44-0aa8-451e-90ff-e6b5431e6787', '8342e96f-6f85-400b-9db5-26ff53a27b6f', '527ce34f-9a9a-48ca-a312-4716f781db8f', '64894815-b276-415c-88a6-3a6ea1d1d632'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Delete snapshot completed successfully. Jul 08 18:53:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-691b694c-4a1c-4e09-a386-123391c65db9 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-0d9641f0-2a08-4138-9ac4-730ca6c351c7-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "cinder-33b8647d-f0b4-44d5-a684-78e2ab7e41c6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-33b8647d-f0b4-44d5-a684-78e2ab7e41c6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22e433-a202-4732-9678-369921978e9f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:30 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 Jul 08 18:53:30 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-e23416b1-21bf-47f2-b663-4c88ee69251e-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "cinder-e23416b1-21bf-47f2-b663-4c88ee69251e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-quobyte-e23416b1-21bf-47f2-b663-4c88ee69251e" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-e23416b1-21bf-47f2-b663-4c88ee69251e" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2720708a-184d-4819-9a07-4922359cdbc2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:31 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e Jul 08 18:53:31 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:32 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" returned: 0 in 1.187s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:32 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6 Jul 08 18:53:32 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:32 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e" returned: 0 in 1.292s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:32 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e Jul 08 18:53:32 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:32 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" returned: 0 in 0.827s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-quobyte-33b8647d-f0b4-44d5-a684-78e2ab7e41c6" released by "delete_volume" :: held 2.130s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:32 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Created reservations ['8ca17656-894f-4094-a2b9-4e2a156ea45e', '1c422cc8-6982-4a48-b3ac-c0b0d20fb4b0', 'eb97d401-390f-472a-8253-63ccc8f9db76', '14d45c29-2195-48cf-bf65-af210b1f84b9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:33 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:33 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:33 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e23416b1-21bf-47f2-b663-4c88ee69251e" returned: 0 in 1.043s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-e23416b1-21bf-47f2-b663-4c88ee69251e" released by "delete_volume" :: held 2.398s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Created reservations ['2238aec7-efc9-465b-a8a3-224693452a0e', 'f9d2d260-ac52-45b5-8889-936e246058c8', 'e68687a9-1f97-45d9-80ae-7a125321911c', '2688db4b-c5c3-4448-a9fd-977e586df191'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:33 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.874s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:33 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Deleted volume successfully. Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:34 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:34 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4ce7a72-b968-480c-9331-95eb5bc650b1 tempest-SnapshotMetadataTestJSON-65013989 None] Lock "cinder-33b8647d-f0b4-44d5-a684-78e2ab7e41c6-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-28e4479b-38bf-4c35-bd87-987344d54882-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-28e4479b-38bf-4c35-bd87-987344d54882-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-quobyte-28e4479b-38bf-4c35-bd87-987344d54882" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-28e4479b-38bf-4c35-bd87-987344d54882" acquired by "delete_volume" :: waited 0.046s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b94944f-bbc3-4ebc-9625-46e8f1cca273]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:35 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 Jul 08 18:53:35 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:35 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.069s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:35 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Deleted volume successfully. Jul 08 18:53:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-26167d71-fd8f-49a1-87aa-bad1edc39eca tempest-VolumesTestJSON-1495306529 None] Lock "cinder-e23416b1-21bf-47f2-b663-4c88ee69251e-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:35 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882" returned: 0 in 0.957s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:35 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882 Jul 08 18:53:35 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:36 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-28e4479b-38bf-4c35-bd87-987344d54882" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-28e4479b-38bf-4c35-bd87-987344d54882" released by "delete_volume" :: held 1.900s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Created reservations ['49f9d972-89c9-4fa4-9b5c-9413c04a315b', '017122e2-be91-4a45-a4cf-e8519c65af10', 'c3426088-a803-4a29-9b5c-7d4c5f7b3234', '31a88285-f0b3-4d34-8235-35636b089f7a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:36 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:36 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-68052560-c880-4efb-b5ec-d94f84ddb131-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-68052560-c880-4efb-b5ec-d94f84ddb131-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "cinder-quobyte-68052560-c880-4efb-b5ec-d94f84ddb131" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-68052560-c880-4efb-b5ec-d94f84ddb131" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e273d6-149c-47ba-85fc-4069690a286a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:53:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:37 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 Jul 08 18:53:37 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:38 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.206s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Deleted volume successfully. Jul 08 18:53:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c0ee0ba6-b53b-43fc-a2e6-6612338424d2 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-28e4479b-38bf-4c35-bd87-987344d54882-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:38 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131" returned: 0 in 1.339s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:38 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131 Jul 08 18:53:38 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:39 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-68052560-c880-4efb-b5ec-d94f84ddb131" returned: 0 in 0.831s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-quobyte-68052560-c880-4efb-b5ec-d94f84ddb131" released by "delete_volume" :: held 2.253s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Created reservations ['ae38a028-1829-4071-90ec-f81a2024b2c3', '490fb091-54fe-45aa-b200-75ca1a04dda4', '54e72062-4b9e-421a-82cc-53c02644d886', '731593ba-aa6e-485a-ae21-2596267faaec'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:39 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:53:39 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:40 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:40 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:53:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Deleted volume successfully. Jul 08 18:53:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc089660-6d00-4401-81bb-8fb33c13a6c7 tempest-VolumesTestJSON-1495306529 None] Lock "cinder-68052560-c880-4efb-b5ec-d94f84ddb131-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Flow 'volume_create_manager' (be4b4148-414e-48c3-8250-dc1284b36850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d760f4fd-8880-492c-99f8-5c94275e0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d760f4fd-8880-492c-99f8-5c94275e0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-971883505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dbc0b4-f42e-49e8-b457-aa3f5bc636cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e042864bc64abbaef78e6623f27cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:44Z,use_quota=True,user_id='5440b603d0444afe99828de8881dbee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75372b70-eb4e-4fe7-8c6a-757ef356f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75372b70-eb4e-4fe7-8c6a-757ef356f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3602d218-ff65-4ba8-bcaf-817ae8635c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3602d218-ff65-4ba8-bcaf-817ae8635c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dbc0b4-f42e-49e8-b457-aa3f5bc636cb', 'volume_name': 'volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3f1146-c02e-4a73-a12b-1f2286ae243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3f1146-c02e-4a73-a12b-1f2286ae243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b80db20-050b-487d-af69-6520130adea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Volume 92dbc0b4-f42e-49e8-b457-aa3f5bc636cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb', 'volume_size': 1} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-971883505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dbc0b4-f42e-49e8-b457-aa3f5bc636cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e042864bc64abbaef78e6623f27cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:53:44Z,use_quota=True,user_id='5440b603d0444afe99828de8881dbee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Creating volume 92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:53:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:53:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:43 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb 1073741824 Jul 08 18:53:43 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:45 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb 1073741824" returned: 0 in 1.593s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:53:45 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:53:45 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:53:46 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 1.171s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] <== create_volume: return (2861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.866s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b80db20-050b-487d-af69-6520130adea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d95828c-61da-4ffb-b412-17fffef4eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:53:46 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Volume volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb (92dbc0b4-f42e-49e8-b457-aa3f5bc636cb): created successfully Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d95828c-61da-4ffb-b412-17fffef4eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:53:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Flow 'volume_create_manager' (be4b4148-414e-48c3-8250-dc1284b36850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:53:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4b5c0154-d894-4615-9a82-6a5d58040cbb tempest-TestStampPattern-329665916 None] Created volume successfully. Jul 08 18:53:56 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=40,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:53:56 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=52,cinder:SELECT=38,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Flow 'volume_create_manager' (bd1912ad-ad23-4bf7-852c-e5779e942dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928bd70a-8e38-4232-8a00-1d4bc6a47cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928bd70a-8e38-4232-8a00-1d4bc6a47cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562919306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4038da26-d538-4104-b1b7-9f2ad320a541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3044dd890baa4b2ca3df94a8dad7f8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='ea4158939bcc4bd796a264532ee1a635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56202ab-5284-4f0c-ae8e-f64626b5088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56202ab-5284-4f0c-ae8e-f64626b5088c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b7faad-85e9-48d9-b7f1-015a4eeeb7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b7faad-85e9-48d9-b7f1-015a4eeeb7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4038da26-d538-4104-b1b7-9f2ad320a541', 'volume_name': 'volume-4038da26-d538-4104-b1b7-9f2ad320a541', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e1fc61-3a1f-440a-b449-c28235d78afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e1fc61-3a1f-440a-b449-c28235d78afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf8e3fb-60ce-4d7e-b286-54d4ea3ac525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Volume 4038da26-d538-4104-b1b7-9f2ad320a541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4038da26-d538-4104-b1b7-9f2ad320a541', 'volume_size': 1} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562919306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4038da26-d538-4104-b1b7-9f2ad320a541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3044dd890baa4b2ca3df94a8dad7f8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:01Z,use_quota=True,user_id='ea4158939bcc4bd796a264532ee1a635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Creating volume 4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:01 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:01 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 1073741824 Jul 08 18:54:01 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (1da364cf-9d4f-46d0-b781-a8b886b3c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d730416a-91bb-41a9-9ba8-5d0efc575846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d730416a-91bb-41a9-9ba8-5d0efc575846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1448498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5e39e1-d968-4dcf-9218-c1094184d2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570379e0-b1a6-4dcc-8c5e-19ad9fee5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570379e0-b1a6-4dcc-8c5e-19ad9fee5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f13494-28a4-42f5-be54-db39e13458a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f13494-28a4-42f5-be54-db39e13458a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5e39e1-d968-4dcf-9218-c1094184d2b2', 'volume_name': 'volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab22b67-31cc-4c71-88fb-d8dbac9285c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab22b67-31cc-4c71-88fb-d8dbac9285c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4db7cdf-0b74-4371-ac0f-d63318a29061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:02 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Volume ed5e39e1-d968-4dcf-9218-c1094184d2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2', 'volume_size': 1} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:02 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 1073741824" returned: 0 in 1.053s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:02 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:54:02 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:03 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.686s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1448498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5e39e1-d968-4dcf-9218-c1094184d2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:02Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Creating volume ed5e39e1-d968-4dcf-9218-c1094184d2b2 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:03 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf8e3fb-60ce-4d7e-b286-54d4ea3ac525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4038da26-d538-4104-b1b7-9f2ad320a541', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0b3be2-b0fe-4aab-a6a5-8bf417aa1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:03 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 1073741824 Jul 08 18:54:03 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Volume volume-4038da26-d538-4104-b1b7-9f2ad320a541 (4038da26-d538-4104-b1b7-9f2ad320a541): created successfully Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0b3be2-b0fe-4aab-a6a5-8bf417aa1051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Flow 'volume_create_manager' (bd1912ad-ad23-4bf7-852c-e5779e942dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-08c26e41-a47c-4173-8cd8-93753875f739 tempest-VolumesActionsTest-751106960 None] Created volume successfully. Jul 08 18:54:04 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 1073741824" returned: 0 in 0.978s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:04 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 Jul 08 18:54:04 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:05 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2" returned: 0 in 0.777s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4db7cdf-0b74-4371-ac0f-d63318a29061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452af016-6f6c-4080-af20-88bf0e0ff90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Volume volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 (ed5e39e1-d968-4dcf-9218-c1094184d2b2): created successfully Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452af016-6f6c-4080-af20-88bf0e0ff90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (1da364cf-9d4f-46d0-b781-a8b886b3c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6da876da-ace9-4789-8d9b-9d2f75152ece tempest-VolumesListAdminTestJSON-323903870 None] Created volume successfully. Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (b59590c3-4570-45e5-9106-971d41213bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b875535f-6de8-4f24-82f7-716be7f677db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b875535f-6de8-4f24-82f7-716be7f677db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-472863561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb485080-0287-4896-8ff9-459fb49a93e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:06Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1728389-f37c-4487-beb6-e199df973c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1728389-f37c-4487-beb6-e199df973c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29470e25-a057-4069-8281-4c45059aed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29470e25-a057-4069-8281-4c45059aed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb485080-0287-4896-8ff9-459fb49a93e6', 'volume_name': 'volume-fb485080-0287-4896-8ff9-459fb49a93e6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0276f1b-2180-4889-97db-455e98baef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0276f1b-2180-4889-97db-455e98baef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbc0674-2bfe-42d2-926f-77c26ada52ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:06 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Volume fb485080-0287-4896-8ff9-459fb49a93e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb485080-0287-4896-8ff9-459fb49a93e6', 'volume_size': 1} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-472863561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb485080-0287-4896-8ff9-459fb49a93e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:06Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Creating volume fb485080-0287-4896-8ff9-459fb49a93e6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:06 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:06 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 1073741824 Jul 08 18:54:06 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:07 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 1073741824" returned: 0 in 1.328s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:07 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 Jul 08 18:54:07 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:08 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6" returned: 0 in 1.001s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbc0674-2bfe-42d2-926f-77c26ada52ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb485080-0287-4896-8ff9-459fb49a93e6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb62371-6652-4026-b889-a7ba0e5dab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Volume volume-fb485080-0287-4896-8ff9-459fb49a93e6 (fb485080-0287-4896-8ff9-459fb49a93e6): created successfully Jul 08 18:54:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb62371-6652-4026-b889-a7ba0e5dab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (b59590c3-4570-45e5-9106-971d41213bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a09269a5-3683-4159-8b02-41c3015a91db tempest-VolumesListAdminTestJSON-323903870 None] Created volume successfully. Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (e0513757-1177-4b56-a3ed-233c89c8f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d2932b-1603-417a-8be3-e8ba8ca3d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d2932b-1603-417a-8be3-e8ba8ca3d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1266233703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a4351f-71d3-4e63-abe8-d6313015dbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:10Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045fe2ff-3c84-4387-accb-0ff13686d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045fe2ff-3c84-4387-accb-0ff13686d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b43026-ee1b-4484-ba01-abbef634ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b43026-ee1b-4484-ba01-abbef634ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a4351f-71d3-4e63-abe8-d6313015dbfa', 'volume_name': 'volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b4ab2-e811-4798-bcd2-1c79944f5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b4ab2-e811-4798-bcd2-1c79944f5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4054ae06-ab6b-496a-86bd-52032da231f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Volume b6a4351f-71d3-4e63-abe8-d6313015dbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa', 'volume_size': 1} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1266233703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a4351f-71d3-4e63-abe8-d6313015dbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7df9a44583e4a91840d139350dd985b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:10Z,use_quota=True,user_id='e01e0b48b7e74477ab40798e5e010177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Creating volume b6a4351f-71d3-4e63-abe8-d6313015dbfa {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:10 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:10 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa 1073741824 Jul 08 18:54:10 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:11 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa 1073741824" returned: 0 in 0.909s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:11 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa Jul 08 18:54:11 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:12 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4054ae06-ab6b-496a-86bd-52032da231f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386dc314-e7cb-4c22-bc70-050586629aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Volume volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa (b6a4351f-71d3-4e63-abe8-d6313015dbfa): created successfully Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386dc314-e7cb-4c22-bc70-050586629aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Flow 'volume_create_manager' (e0513757-1177-4b56-a3ed-233c89c8f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-acf73c16-30ea-492b-b278-e53e5428b8e5 tempest-VolumesListAdminTestJSON-323903870 None] Created volume successfully. Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Flow 'volume_create_manager' (24564140-1bb5-41d8-9efd-1a79861e4b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86023264-b1d4-491d-b702-cb8534623ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86023264-b1d4-491d-b702-cb8534623ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1897463264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb50ef4-1a93-43a7-855a-65004f757e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b83d43861a3483fb05abf1b3bd60964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:13Z,use_quota=True,user_id='bbe6449d113f472f8dd1c2714bc0b65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969fe9d1-a046-4b20-81b0-5f1e30305170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969fe9d1-a046-4b20-81b0-5f1e30305170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907432cc-1f0d-4cb6-9104-a261b38876ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907432cc-1f0d-4cb6-9104-a261b38876ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb50ef4-1a93-43a7-855a-65004f757e58', 'volume_name': 'volume-6bb50ef4-1a93-43a7-855a-65004f757e58', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d094ed0e-62ff-4645-ab6b-8f4bda3e6feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d094ed0e-62ff-4645-ab6b-8f4bda3e6feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63daeda-69de-41b5-9291-c4e5b3dc937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Volume 6bb50ef4-1a93-43a7-855a-65004f757e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb50ef4-1a93-43a7-855a-65004f757e58', 'volume_size': 1} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1897463264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb50ef4-1a93-43a7-855a-65004f757e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b83d43861a3483fb05abf1b3bd60964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:13Z,use_quota=True,user_id='bbe6449d113f472f8dd1c2714bc0b65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Creating volume 6bb50ef4-1a93-43a7-855a-65004f757e58 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:13 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:13 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 1073741824 Jul 08 18:54:13 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Flow 'volume_create_manager' (09c49f21-6884-4c31-8e65-61b6cf3fc1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447b74b-1908-4429-987e-7ad68756ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c447b74b-1908-4429-987e-7ad68756ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c2aed1-865a-4e4f-9a2d-8caac9b43360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3accfe0a31974ed98710caaaca841baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:14Z,use_quota=True,user_id='d6f73690d9484282b6eac8a291819ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6980438f-54ed-4df6-9172-f71b90f19ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6980438f-54ed-4df6-9172-f71b90f19ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fda6ed6-ef80-437c-af47-19202db4fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fda6ed6-ef80-437c-af47-19202db4fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c2aed1-865a-4e4f-9a2d-8caac9b43360', 'volume_name': 'volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65652cf-378b-4150-b17a-aeb3c404c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65652cf-378b-4150-b17a-aeb3c404c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afced2-0f0a-4b86-a097-77715e61ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Volume a2c2aed1-865a-4e4f-9a2d-8caac9b43360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360', 'volume_size': 1} Jul 08 18:54:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:14 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 1073741824" returned: 0 in 1.336s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:14 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 Jul 08 18:54:14 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:15 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58" returned: 0 in 0.778s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c2aed1-865a-4e4f-9a2d-8caac9b43360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3accfe0a31974ed98710caaaca841baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:14Z,use_quota=True,user_id='d6f73690d9484282b6eac8a291819ab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Creating volume a2c2aed1-865a-4e4f-9a2d-8caac9b43360 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:15 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63daeda-69de-41b5-9291-c4e5b3dc937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb50ef4-1a93-43a7-855a-65004f757e58', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:15 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 1073741824 Jul 08 18:54:15 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc351bde-09ec-40d8-85f8-bc588168cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Volume volume-6bb50ef4-1a93-43a7-855a-65004f757e58 (6bb50ef4-1a93-43a7-855a-65004f757e58): created successfully Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc351bde-09ec-40d8-85f8-bc588168cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Flow 'volume_create_manager' (24564140-1bb5-41d8-9efd-1a79861e4b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-46a0ddcc-7f1b-481a-bfcc-a24f4ff38496 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Created volume successfully. Jul 08 18:54:16 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 1073741824" returned: 0 in 0.949s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:16 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 Jul 08 18:54:16 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:17 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" returned: 0 in 0.690s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afced2-0f0a-4b86-a097-77715e61ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61acb10b-ceda-46e2-b7c2-b6aa78c515a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Volume volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 (a2c2aed1-865a-4e4f-9a2d-8caac9b43360): created successfully Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61acb10b-ceda-46e2-b7c2-b6aa78c515a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Flow 'volume_create_manager' (09c49f21-6884-4c31-8e65-61b6cf3fc1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c254989b-5b9f-4997-9e60-3c73d263d86e tempest-VolumesListAdminTestJSON-37429156 None] Created volume successfully. Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Acquiring lock "cinder-a2c2aed1-865a-4e4f-9a2d-8caac9b43360-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "cinder-a2c2aed1-865a-4e4f-9a2d-8caac9b43360-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:18 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Acquiring lock "cinder-quobyte-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:18 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "cinder-quobyte-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a8b25-18f5-464c-862a-108e69689eb8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-b6a4351f-71d3-4e63-abe8-d6313015dbfa-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-b6a4351f-71d3-4e63-abe8-d6313015dbfa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-quobyte-b6a4351f-71d3-4e63-abe8-d6313015dbfa" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-b6a4351f-71d3-4e63-abe8-d6313015dbfa" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:18 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 Jul 08 18:54:18 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e140df3a-8740-411e-9d90-acff5c916c8b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:18 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa Jul 08 18:54:18 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:19 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.053s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:54:19 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" returned: 0 in 1.073s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:19 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360 Jul 08 18:54:19 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0cdbf8-7fe0-4523-ace6-9059faa04b85]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:19 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa" returned: 0 in 1.255s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:19 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa Jul 08 18:54:19 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:19 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 Jul 08 18:54:19 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:20 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" returned: 0 in 0.844s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "cinder-quobyte-a2c2aed1-865a-4e4f-9a2d-8caac9b43360" released by "delete_volume" :: held 2.001s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Created reservations ['e13b9424-6770-417f-8332-c00ef6941c06', '81e32e08-6cce-43e4-936b-c2bb93762cd4', '5e797b3e-6db1-4985-ae02-5602c68951dd', '482df55b-a939-4e7b-8b36-fa18ee718774'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:20 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:20 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:20 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b6a4351f-71d3-4e63-abe8-d6313015dbfa" returned: 0 in 0.881s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-b6a4351f-71d3-4e63-abe8-d6313015dbfa" released by "delete_volume" :: held 2.218s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Created reservations ['31afc895-c3b8-40fa-be25-0636a7d84c3e', 'b73f9a82-5559-4c53-ac9f-b9bb1551fa74', '809bfd66-5780-496e-91a7-067629e882e0', 'af3cf70b-fcf0-4a1f-b47f-a7851e02d330'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:20 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58" returned: 0 in 1.050s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-6bb50ef4-1a93-43a7-855a-65004f757e58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c0ca44a-9233-4beb-909e-410a77d86fdd', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:21 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:21 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-73c95ebc-306f-4a76-98a7-4f5edcad842a req-6657c70c-b01c-4099-8bc5-125c53fd2631 tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] attachment_update completed successfully. Jul 08 18:54:21 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.858s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Deleted volume successfully. Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-861dbf17-2d36-4072-b646-1023b2b8fffe tempest-VolumesListAdminTestJSON-37429156 None] Lock "cinder-a2c2aed1-865a-4e4f-9a2d-8caac9b43360-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:21 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.836s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Deleted volume successfully. Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e4f2b64c-fadf-4d2e-8f86-db83b63c1637 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-b6a4351f-71d3-4e63-abe8-d6313015dbfa-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-fb485080-0287-4896-8ff9-459fb49a93e6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-fb485080-0287-4896-8ff9-459fb49a93e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-quobyte-fb485080-0287-4896-8ff9-459fb49a93e6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-fb485080-0287-4896-8ff9-459fb49a93e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[452837a8-da94-4ddf-8ce6-1b717774e712]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:22 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 Jul 08 18:54:22 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:22 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:22 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6 Jul 08 18:54:22 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:23 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-52d83c06-bd1b-4437-a33a-622a0ee2a954 tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" by "attach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fb485080-0287-4896-8ff9-459fb49a93e6" returned: 0 in 0.821s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-fb485080-0287-4896-8ff9-459fb49a93e6" released by "delete_volume" :: held 1.737s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-52d83c06-bd1b-4437-a33a-622a0ee2a954 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" acquired by "attach_volume" :: waited 0.051s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Created reservations ['2ab9f8d5-20d9-4ad9-b073-375a389481f1', '448391cd-5a98-420d-84b3-08ed0c76f16d', '1fb8b7a4-07c2-48c9-b88d-dbc75b9a7f4a', 'ade32a15-c1e5-4087-9880-d68971e8e557'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-52d83c06-bd1b-4437-a33a-622a0ee2a954 tempest-VolumesActionsTest-751106960 None] Attaching volume 4038da26-d538-4104-b1b7-9f2ad320a541 to instance 55627e4a-a253-47ff-b474-d4e76b1de6af at mountpoint /dev/vdb on host None. Jul 08 18:54:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-52d83c06-bd1b-4437-a33a-622a0ee2a954 tempest-VolumesActionsTest-751106960 None] Attach volume completed successfully. Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-52d83c06-bd1b-4437-a33a-622a0ee2a954 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" released by "attach_volume" :: held 0.117s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:24 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:24 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-ed5e39e1-d968-4dcf-9218-c1094184d2b2-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8bdf1a7e-1dad-48d2-a550-c6a0e530f852 tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" by "detach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-ed5e39e1-d968-4dcf-9218-c1094184d2b2-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8bdf1a7e-1dad-48d2-a550-c6a0e530f852 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8bdf1a7e-1dad-48d2-a550-c6a0e530f852 tempest-VolumesActionsTest-751106960 None] Detaching volume 4038da26-d538-4104-b1b7-9f2ad320a541 from instance 55627e4a-a253-47ff-b474-d4e76b1de6af. Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "cinder-quobyte-ed5e39e1-d968-4dcf-9218-c1094184d2b2" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-ed5e39e1-d968-4dcf-9218-c1094184d2b2" acquired by "delete_volume" :: waited 0.038s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8bdf1a7e-1dad-48d2-a550-c6a0e530f852 tempest-VolumesActionsTest-751106960 None] Detach volume completed successfully. Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8bdf1a7e-1dad-48d2-a550-c6a0e530f852 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46699b1a-1f22-4628-8565-d07da70b0224]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:24 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 Jul 08 18:54:24 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:24 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.867s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Deleted volume successfully. Jul 08 18:54:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef326cb1-5f6b-4fa7-92e6-9fcbb5dd0c2d tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-fb485080-0287-4896-8ff9-459fb49a93e6-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:25 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2" returned: 0 in 0.954s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:25 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2 Jul 08 18:54:25 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:26 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ed5e39e1-d968-4dcf-9218-c1094184d2b2" returned: 0 in 0.679s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-quobyte-ed5e39e1-d968-4dcf-9218-c1094184d2b2" released by "delete_volume" :: held 1.697s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Created reservations ['c03aaaf4-36b3-4916-ac65-9c387f135457', 'a763f7b1-d839-47fa-b52f-4a48783b3e4b', '57a35362-66e1-49ef-bd49-639ae612b766', 'a031ae93-a433-4390-b8fe-96dea060cdc0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:26 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:26 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:27 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.835s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:27 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Deleted volume successfully. Jul 08 18:54:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21905d42-3cce-4a21-9634-c55b95217a85 tempest-VolumesListAdminTestJSON-323903870 None] Lock "cinder-ed5e39e1-d968-4dcf-9218-c1094184d2b2-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-f4ec47c2-c06c-4da9-92b2-0ce00c8ca3d1 req-e534742d-0ca1-41b2-981e-e00d2d1a19dc tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Terminate volume connection completed successfully. Jul 08 18:54:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-f4ec47c2-c06c-4da9-92b2-0ce00c8ca3d1 req-e534742d-0ca1-41b2-981e-e00d2d1a19dc tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Deleting attachment 8c0ca44a-9233-4beb-909e-410a77d86fdd. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "cinder-6bb50ef4-1a93-43a7-855a-65004f757e58-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "cinder-6bb50ef4-1a93-43a7-855a-65004f757e58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "cinder-quobyte-6bb50ef4-1a93-43a7-855a-65004f757e58" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "cinder-quobyte-6bb50ef4-1a93-43a7-855a-65004f757e58" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb1e23-17e2-4bb7-b28a-4b8248b0b54f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:30 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 Jul 08 18:54:30 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:31 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58" returned: 0 in 0.860s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:31 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58 Jul 08 18:54:31 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:32 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6bb50ef4-1a93-43a7-855a-65004f757e58" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "cinder-quobyte-6bb50ef4-1a93-43a7-855a-65004f757e58" released by "delete_volume" :: held 1.688s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Created reservations ['13076fc3-b530-4882-986e-ccbd125e44ac', 'bdd889e1-f990-491c-97e3-e28c6b80227d', '4ca353a6-49d2-42d7-aa14-189b37e29a2b', '5b00dfc9-d8df-4d99-baa0-93cdfe17f77d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:32 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:54:32 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e891c-95a1-4c0a-b391-45f2599bba86]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:33 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:54:33 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:33 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:54:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Deleted volume successfully. Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a647a110-389c-4b2f-92b9-acf07c2e990f tempest-TestServerVolumeAttachScenarioOldVersion-2131311105 None] Lock "cinder-6bb50ef4-1a93-43a7-855a-65004f757e58-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:33 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.968s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21319bf6-8a62-4a1a-a8af-b78a729f9bf3', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:54:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-9dbaa194-1acc-492d-8e76-6d885b5c9e1b req-498f3b65-f7a1-4b52-88f1-0142f9da46cb tempest-TestStampPattern-329665916 None] attachment_update completed successfully. Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (960ac076-ce8b-467c-bf42-8f9908c4370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca716a91-7326-4b3d-a75e-243d7eec596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca716a91-7326-4b3d-a75e-243d7eec596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275166442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f701f2feaaba4669910280d174e90908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:35Z,use_quota=True,user_id='3f16fc3e3d104bc0a231a9de05411826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f2acd-4cf6-455c-b8aa-ca4c3b9f7c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f2acd-4cf6-455c-b8aa-ca4c3b9f7c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d12a0b-0984-412b-884a-7746d73e7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d12a0b-0984-412b-884a-7746d73e7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0', 'volume_name': 'volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36f0921-a30a-48d5-85c1-0d7460b9a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36f0921-a30a-48d5-85c1-0d7460b9a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860c1905-dd2f-4c3f-98fe-f33f2fc02ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0', 'volume_size': 1} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275166442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f701f2feaaba4669910280d174e90908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:54:35Z,use_quota=True,user_id='3f16fc3e3d104bc0a231a9de05411826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Creating volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:54:35 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:54:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:35 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 1073741824 Jul 08 18:54:35 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:36 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 1073741824" returned: 0 in 1.108s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:36 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:54:36 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:36 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 0.694s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860c1905-dd2f-4c3f-98fe-f33f2fc02ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aea23cd-7e5c-412a-b5c8-1b4168e25995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:54:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Volume volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 (9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0): created successfully Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aea23cd-7e5c-412a-b5c8-1b4168e25995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:54:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (960ac076-ce8b-467c-bf42-8f9908c4370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:54:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-336a35fa-3459-43b2-aee9-e79b779d1d22 tempest-VolumesDeleteCascade-104518301 None] Created volume successfully. Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Creating offline snapshot 2380b36b-2757-4f21-869a-842cf59bbd67 of volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41352e35-32f4-4de5-a86a-cf74cadc690d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:38 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:54:38 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:38 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 0.809s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:39 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 1G Jul 08 18:54:39 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:40 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 1G" returned: 0 in 1.304s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:40 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:40 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:41 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 1.065s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:41 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 is being set with open permissions: ugo+rw Jul 08 18:54:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:41 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:41 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:42 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 0.980s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:42 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info Jul 08 18:54:42 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:43 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info" returned: 0 in 0.771s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:43 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info is being set with open permissions: ugo+rw Jul 08 18:54:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:43 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info Jul 08 18:54:43 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:43 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.info" returned: 0 in 0.721s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.753s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ff697930-f5ed-4ede-85db-ccedcbaa90ab tempest-VolumesDeleteCascade-104518301 None] Create snapshot completed successfully Jul 08 18:54:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-52e1da75-f820-4220-8fb5-cc1ac1fcb340 req-0e06c09d-b6bc-41c1-afea-70a61a34e814 tempest-TestStampPattern-329665916 None] Terminate volume connection completed successfully. Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-52e1da75-f820-4220-8fb5-cc1ac1fcb340 req-0e06c09d-b6bc-41c1-afea-70a61a34e814 tempest-TestStampPattern-329665916 None] Deleting attachment 21319bf6-8a62-4a1a-a8af-b78a729f9bf3. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Creating offline snapshot 2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b of volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6a3508-1d1f-4fbd-898b-4f2c33193de0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:44 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:44 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:45 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:45 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b 1G Jul 08 18:54:45 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:54:47 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b 1G" returned: 0 in 1.277s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:47 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:54:47 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:48 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 0.997s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:48 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b is being set with open permissions: ugo+rw Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:48 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:54:48 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:48 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 0.901s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.307s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.148s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:54:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Creating offline snapshot 5f8b8d31-0a24-40fd-a566-7debdfee5e49 of volume 92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:54:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3ccf4108-32cd-4620-ad5e-9ce8d7850a7b tempest-VolumesDeleteCascade-104518301 None] Create snapshot completed successfully Jul 08 18:54:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af0f3c-c359-413d-ae6a-8e6eabe66ec2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:49 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:54:49 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:50 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.980s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:50 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 1G Jul 08 18:54:50 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Performing cascade delete. {{(pid=87229) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-2380b36b-2757-4f21-869a-842cf59bbd67-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-2380b36b-2757-4f21-869a-842cf59bbd67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-2380b36b-2757-4f21-869a-842cf59bbd67" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-2380b36b-2757-4f21-869a-842cf59bbd67" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Deleting offline snapshot 2380b36b-2757-4f21-869a-842cf59bbd67 of volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] snapshot_file for this snap is: volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1162f87-96b6-4166-9c75-649d919acd80]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:50 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:50 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f941b33f-99c3-44c1-b8ff-55c3d26e9dfb tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" by "attach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f941b33f-99c3-44c1-b8ff-55c3d26e9dfb tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" acquired by "attach_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:50 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f941b33f-99c3-44c1-b8ff-55c3d26e9dfb tempest-VolumesActionsTest-751106960 None] Attaching volume 4038da26-d538-4104-b1b7-9f2ad320a541 to instance 47c26634-3792-4a85-afa7-161b939330f0 at mountpoint /dev/vdb on host None. Jul 08 18:54:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f941b33f-99c3-44c1-b8ff-55c3d26e9dfb tempest-VolumesActionsTest-751106960 None] Attach volume completed successfully. Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f941b33f-99c3-44c1-b8ff-55c3d26e9dfb tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541" released by "attach_volume" :: held 0.236s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef43c93b-6208-46c6-b073-d52561797620 tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" by "detach_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef43c93b-6208-46c6-b073-d52561797620 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ef43c93b-6208-46c6-b073-d52561797620 tempest-VolumesActionsTest-751106960 None] Detaching volume 4038da26-d538-4104-b1b7-9f2ad320a541 from instance 47c26634-3792-4a85-afa7-161b939330f0. Jul 08 18:54:51 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 1G" returned: 0 in 1.622s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:51 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:54:51 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ef43c93b-6208-46c6-b073-d52561797620 tempest-VolumesActionsTest-751106960 None] Detach volume completed successfully. Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ef43c93b-6208-46c6-b073-d52561797620 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:51 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 1.329s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49acbb4-9581-4075-a6ce-032ea20306cc]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:52 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:54:52 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:52 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 1.305s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:52 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 is being set with open permissions: ugo+rw Jul 08 18:54:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:52 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:54:52 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:53 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 1.197s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f147c188-c810-4748-b12a-0e5369625fb5]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:53 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:54:53 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:53 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 0.787s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:53 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info Jul 08 18:54:53 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:54 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 1.096s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcf4b96-6e62-47b1-b376-a2ebbb699615]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:54 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:54 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:54 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info" returned: 0 in 0.891s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:54 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info is being set with open permissions: ugo+rw Jul 08 18:54:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:54 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info Jul 08 18:54:54 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:55 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 1.274s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e02a7e5-a63e-47f7-ba05-a72e2f0f8c45]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:55 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.info" returned: 0 in 0.992s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.721s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:54:55 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:54:55 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d31672b7-cd03-40b9-b1be-12cd8e384c91 tempest-TestStampPattern-329665916 None] Create snapshot completed successfully Jul 08 18:54:56 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 0.809s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:56 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:56 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:57 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 0.914s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:57 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67 Jul 08 18:54:57 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:58 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2380b36b-2757-4f21-869a-842cf59bbd67" returned: 0 in 0.714s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b -F qcow2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:58 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b -F qcow2 Jul 08 18:54:58 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:54:58 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b -F qcow2" returned: 0 in 0.789s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-2380b36b-2757-4f21-869a-842cf59bbd67" released by "_delete_snapshot" :: held 8.385s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" released by "delete_snapshot" :: held 8.439s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=76,cinder:SELECT=78,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=78,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:54:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['0b19b7b2-6eba-4083-92f4-717f03597c2c', 'f209fbaa-367b-451f-bac6-23ca8b7417dd', 'bec2bfa0-0139-40a5-bbe8-06226cea1eb1', 'b0abebb3-e767-413a-8c53-26d3ab076bee'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:54:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Delete snapshot completed successfully. Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-2380b36b-2757-4f21-869a-842cf59bbd67-delete_snapshot" released by "delete_snapshot" :: held 8.746s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Deleting offline snapshot 2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b of volume 9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] snapshot_file for this snap is: volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae7231-eb96-4339-8581-8fd5e3a52a3e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:54:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:54:59 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:54:59 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:00 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:55:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fcb275-011b-48b6-a271-04fd5921878b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:00 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:55:00 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[611c2d1b-21de-44f9-a7a1-75b66a1f4e80]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:01 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:01 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:01 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 0.988s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:01 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:55:01 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:02 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ac444-c720-4625-878c-f4381d73ce99]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:02 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:02 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:02 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 1.110s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:02 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b Jul 08 18:55:02 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:02 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.898s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.08ab0e62-3797-4418-b063-465bd8626977knm8s0gd.img {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:02 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.08ab0e62-3797-4418-b063-465bd8626977knm8s0gd.img Jul 08 18:55:02 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:03 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0.2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" returned: 0 in 0.699s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b" released by "_delete_snapshot" :: held 3.890s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" released by "delete_snapshot" :: held 3.922s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['f5747b17-3530-4cbb-8b93-6fa0b729f986', 'a06481f1-785f-45a7-aee5-24ef210dc4e6', '1bf0beca-fb8f-484c-b534-9f4f2a8e5124', '692c67e1-444f-4678-8e73-f553849240d8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Delete snapshot completed successfully. Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-2b41941a-fb8e-4ecc-ae4c-bafb3f1a5b2b-delete_snapshot" released by "delete_snapshot" :: held 4.177s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Snapshots deleted, issuing volume delete {{(pid=87229) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47d65a-4912-4d46-a58b-175f193634da]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:03 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:55:03 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:04 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 1.306s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:04 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0 Jul 08 18:55:04 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:06 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" returned: 0 in 1.560s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0" released by "delete_volume" :: held 3.024s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['e3abf552-c817-44d4-a206-763e207117c3', '146c9085-faf4-4864-8ac6-b56f6190d1b1', '8d7e7af6-dede-4a14-8cdd-cfc755ad5111', '3a18bc65-ce59-4dee-a482-f813a8f756c2'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:06 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:55:06 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:08 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (26493601-0b10-4bfa-ba64-e4d081271bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80d31d9-bcd6-4cea-bd08-bf6599c833fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 2.029s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80d31d9-bcd6-4cea-bd08-bf6599c833fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-155471687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37aa4fb2-6857-46b0-b39f-53c646f7d8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f701f2feaaba4669910280d174e90908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:09Z,use_quota=True,user_id='3f16fc3e3d104bc0a231a9de05411826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8202123-5b7a-4472-88d0-f5cfbc040e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8202123-5b7a-4472-88d0-f5cfbc040e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef98f35-db8f-4ab4-95b5-3417d9c787e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef98f35-db8f-4ab4-95b5-3417d9c787e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37aa4fb2-6857-46b0-b39f-53c646f7d8e8', 'volume_name': 'volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f8c706-2cb9-4485-afc9-d94674610de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f8c706-2cb9-4485-afc9-d94674610de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33115f1-79b3-4396-8fc2-6b44d76396e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:09 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Volume 37aa4fb2-6857-46b0-b39f-53c646f7d8e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8', 'volume_size': 1} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Deleted volume successfully. Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-63147a44-7e63-4f43-9045-fd35a5157593 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-9e5f2a8a-78d4-44a4-a4c8-d0b75ef744c0-delete_volume" released by "delete_volume" :: held 18.898s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:09 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.08ab0e62-3797-4418-b063-465bd8626977knm8s0gd.img" returned: 0 in 6.813s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96350fc-d696-4b78-abaa-8651510e9630]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:09 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:09 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:10 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 1.082s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:10 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.08ab0e62-3797-4418-b063-465bd8626977knm8s0gd.img {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:55:10 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Converted 1024.00 MB image at 150.19 MB/s Jul 08 18:55:10 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] 08ab0e62-3797-4418-b063-465bd8626977 was raw, no need to convert to raw {{(pid=87229) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Flow 'volume_create_manager' (6ac47247-b171-49e3-9244-e307abdfcdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995e806-1512-47b3-b86f-06bccc1417ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995e806-1512-47b3-b86f-06bccc1417ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1149203811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aec0538-8288-4448-840f-934a3ad73039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e042864bc64abbaef78e6623f27cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f8b8d31-0a24-40fd-a566-7debdfee5e49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:11Z,use_quota=True,user_id='5440b603d0444afe99828de8881dbee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385acbc5-61e8-411f-94cb-d6db1df67007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385acbc5-61e8-411f-94cb-d6db1df67007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4880a1b-3d48-4597-a09b-b841dc3056ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4880a1b-3d48-4597-a09b-b841dc3056ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8aec0538-8288-4448-840f-934a3ad73039', 'volume_name': 'volume-8aec0538-8288-4448-840f-934a3ad73039', 'volume_size': 1, 'snapshot_id': '5f8b8d31-0a24-40fd-a566-7debdfee5e49'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2873da2d-c8a1-4841-9ba1-a729400ce5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2873da2d-c8a1-4841-9ba1-a729400ce5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622d2e00-3018-4f77-89c6-54910d05519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:11 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Volume 8aec0538-8288-4448-840f-934a3ad73039: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8aec0538-8288-4448-840f-934a3ad73039', 'volume_size': 1, 'snapshot_id': '5f8b8d31-0a24-40fd-a566-7debdfee5e49'} Jul 08 18:55:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:18 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:55:18 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:19 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.866s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:55:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:55:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:55:21 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:INSERT=5,cinder:UPDATE=21,cinder:SELECT=15 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:21 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.260s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Uploaded volume to glance image-id: 08ab0e62-3797-4418-b063-465bd8626977. {{(pid=87229) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.205s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-155471687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37aa4fb2-6857-46b0-b39f-53c646f7d8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f701f2feaaba4669910280d174e90908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:55:09Z,use_quota=True,user_id='3f16fc3e3d104bc0a231a9de05411826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Creating volume 37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:33 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:55:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:33 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 1073741824 Jul 08 18:55:33 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3a9def32-3a9b-4616-b7c6-2699340a53a7 tempest-VolumesActionsTest-751106960 None] Copy volume to image completed successfully. Jul 08 18:55:34 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 1073741824" returned: 0 in 0.898s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:34 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:55:34 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:34 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 23.381s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49-8aec0538-8288-4448-840f-934a3ad73039" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33115f1-79b3-4396-8fc2-6b44d76396e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce0984d-1d56-4cfc-918b-d7a2701c9947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49-8aec0538-8288-4448-840f-934a3ad73039" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Creating volume 8aec0538-8288-4448-840f-934a3ad73039 from snapshot 5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Volume volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 (37aa4fb2-6857-46b0-b39f-53c646f7d8e8): created successfully Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce0984d-1d56-4cfc-918b-d7a2701c9947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (26493601-0b10-4bfa-ba64-e4d081271bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] snapshot: 5f8b8d31-0a24-40fd-a566-7debdfee5e49, volume: 8aec0538-8288-4448-840f-934a3ad73039, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:55:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3626848f-9917-4ff5-aaa9-fee278c997c8 tempest-VolumesDeleteCascade-104518301 None] Created volume successfully. Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9c6cb-d5b1-4ab8-a8ad-efe46d64b707]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:35 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:55:35 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:35 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2175eeeb-a31b-4bb1-8624-3a1652334ee0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:36 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:55:36 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:36 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.813s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:36 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:55:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:36 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 Jul 08 18:55:36 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:42 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039" returned: 0 in 5.452s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:42 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5290a041-e24c-4980-a182-0a8eddb34238]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:42 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:55:42 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:43 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.925s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:55:43 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Converted 1024.00 MB image at 187.76 MB/s Jul 08 18:55:43 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 is being set with open permissions: ugo+rw Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:43 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 Jul 08 18:55:43 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:43 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039" returned: 0 in 0.655s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" released by "_copy_volume_from_snapshot" :: held 8.765s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49-8aec0538-8288-4448-840f-934a3ad73039" released by "_create_volume_from_snapshot" :: held 8.821s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.852s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.890s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3846e8-c397-465d-b7e4-d5ccadde07bb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622d2e00-3018-4f77-89c6-54910d05519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aec0538-8288-4448-840f-934a3ad73039', 'volume_size': 1, 'snapshot_id': '5f8b8d31-0a24-40fd-a566-7debdfee5e49'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56e73e3-0387-4e61-b0f6-51de572bfe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Volume volume-8aec0538-8288-4448-840f-934a3ad73039 (8aec0538-8288-4448-840f-934a3ad73039): created successfully Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56e73e3-0387-4e61-b0f6-51de572bfe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Flow 'volume_create_manager' (6ac47247-b171-49e3-9244-e307abdfcdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e2aba5fc-61fa-408a-99be-e0c597bfb6b3 tempest-TestStampPattern-329665916 None] Created volume successfully. Jul 08 18:55:43 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:43 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:44 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.752s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05be285-0643-43bc-8bd8-745c4ca23aba]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:44 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:44 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:45 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:45 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img Jul 08 18:55:45 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:49 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img" returned: 0 in 4.216s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b721b7-c529-4c94-8f41-389c05d29a38]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:49 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:49 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:50 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.891s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:50 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:55:50 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Converted 1024.00 MB image at 242.77 MB/s Jul 08 18:55:50 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] a3ffe2e0-f4e6-4bc8-bcac-40c21e7a0273 was raw, converting to qcow2 {{(pid=87229) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 18:55:50 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a79fe-75a5-491b-90ca-5465d3631476]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:50 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img Jul 08 18:55:50 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:51 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:51 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img Jul 08 18:55:51 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:51 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img" returned: 1 in 0.729s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:55:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img /opt/stack/data/cinder/conversion/vol_upload_dortm3c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:51 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img /opt/stack/data/cinder/conversion/vol_upload_dortm3c7 Jul 08 18:55:51 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:52 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img /opt/stack/data/cinder/conversion/vol_upload_dortm3c7" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:52 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Image conversion details: src /opt/stack/data/cinder/conversion/4038da26-d538-4104-b1b7-9f2ad320a541.temp_image.a3ffe2e0-f4e6-4bc8-bcac-40c21e7a027316yvtp0n.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dortm3c7 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:55:52 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 18:55:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b015aa99-002f-41bc-badb-45ff04acf07b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dortm3c7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:52 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dortm3c7 Jul 08 18:55:52 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:53 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dortm3c7" returned: 0 in 0.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:53 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.797s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Uploaded volume to glance image-id: a3ffe2e0-f4e6-4bc8-bcac-40c21e7a0273. {{(pid=87229) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.353s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Creating offline snapshot c56cc4d3-ce30-4b36-9d77-e0e935d18d1c of volume 37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:55:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c9189771-83c3-4be5-ba7b-68c42f6ad231 tempest-VolumesActionsTest-751106960 None] Copy volume to image completed successfully. Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf433f29-6beb-445e-8a51-6be7d38214e9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:54 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:55:54 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:55 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.818s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:55 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c 1G Jul 08 18:55:55 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Acquiring lock "cinder-quobyte-4038da26-d538-4104-b1b7-9f2ad320a541" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "cinder-quobyte-4038da26-d538-4104-b1b7-9f2ad320a541" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951f323-cfaf-4bbf-85d6-c20f769a6d6e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:55:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:55 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:55 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:56 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c 1G" returned: 0 in 0.823s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:56 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:55:56 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:56 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.820s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:56 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541 Jul 08 18:55:56 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:56 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:56 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c is being set with open permissions: ugo+rw Jul 08 18:55:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:56 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:55:56 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:57 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4038da26-d538-4104-b1b7-9f2ad320a541" returned: 0 in 0.664s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "cinder-quobyte-4038da26-d538-4104-b1b7-9f2ad320a541" released by "delete_volume" :: held 1.520s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Created reservations ['ce58193a-ef05-4fe0-bc1f-e4d9b1524389', 'e0b6cc15-823d-4ac1-b5e5-57fcecc02ca8', '03bb98b0-5c17-485a-a5d0-11d55dc1b16d', 'ece3009e-c837-4cce-b02b-df7d98824d38'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:57 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:55:57 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:57 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:57 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info Jul 08 18:55:57 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:57 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.692s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:55:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Deleted volume successfully. Jul 08 18:55:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-660052c2-44e8-4388-8040-749c62843f42 tempest-VolumesActionsTest-751106960 None] Lock "cinder-4038da26-d538-4104-b1b7-9f2ad320a541-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:55:58 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:58 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info is being set with open permissions: ugo+rw Jul 08 18:55:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:55:58 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info Jul 08 18:55:58 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:55:59 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.info" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.540s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8586b9b1-843e-441d-ab48-688c2becbc62 tempest-VolumesDeleteCascade-104518301 None] Create snapshot completed successfully Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (57910b4f-dfd3-4821-8bb4-9f616735eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7de81d0-765a-49de-964a-9c672d39496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7de81d0-765a-49de-964a-9c672d39496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-552029759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3995d438-6107-4f5e-9603-e37734b3ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f701f2feaaba4669910280d174e90908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c56cc4d3-ce30-4b36-9d77-e0e935d18d1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:00Z,use_quota=True,user_id='3f16fc3e3d104bc0a231a9de05411826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6ba2d4-a20c-4bbc-b3c1-aa75af880743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6ba2d4-a20c-4bbc-b3c1-aa75af880743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e3779c-5c3f-48a6-888a-12556b388a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e3779c-5c3f-48a6-888a-12556b388a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3995d438-6107-4f5e-9603-e37734b3ee57', 'volume_name': 'volume-3995d438-6107-4f5e-9603-e37734b3ee57', 'volume_size': 1, 'snapshot_id': 'c56cc4d3-ce30-4b36-9d77-e0e935d18d1c'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73560ae-49b9-4522-8ba1-ac51f05225ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73560ae-49b9-4522-8ba1-ac51f05225ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7942ae84-b31f-4c9b-b582-f26d4baee828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:55:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Volume 3995d438-6107-4f5e-9603-e37734b3ee57: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3995d438-6107-4f5e-9603-e37734b3ee57', 'volume_size': 1, 'snapshot_id': 'c56cc4d3-ce30-4b36-9d77-e0e935d18d1c'} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-3995d438-6107-4f5e-9603-e37734b3ee57" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-3995d438-6107-4f5e-9603-e37734b3ee57" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Creating volume 3995d438-6107-4f5e-9603-e37734b3ee57 from snapshot c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:55:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] snapshot: c56cc4d3-ce30-4b36-9d77-e0e935d18d1c, volume: 3995d438-6107-4f5e-9603-e37734b3ee57, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf38a5-b097-452c-87ae-afca103f273c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:00 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:56:00 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:00 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.828s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccd8fff-bec4-464b-8a2a-d0e7c05086f2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:01 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:56:01 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:01 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:01 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:56:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:01 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 Jul 08 18:56:01 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Flow 'volume_create_manager' (28168c7b-e450-48d5-a2e9-7ed5c7713949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26164f0a-8ad7-4013-9f0f-f592cb171a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26164f0a-8ad7-4013-9f0f-f592cb171a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2047137247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a135f31-69f7-4f2c-b4e0-39d23371bdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52c6c14053243918236827a101b289d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:05Z,use_quota=True,user_id='1f489974f81d4a7885b8034daa6fda06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0067a7a8-a66c-41e4-9f1e-90f5ee433e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0067a7a8-a66c-41e4-9f1e-90f5ee433e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b200d15-5ef6-4c46-bde7-83dcb4001b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b200d15-5ef6-4c46-bde7-83dcb4001b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a135f31-69f7-4f2c-b4e0-39d23371bdcb', 'volume_name': 'volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb', 'volume_size': 2}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f7bb4e-26e4-4a64-9d06-7cf8eb56bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f7bb4e-26e4-4a64-9d06-7cf8eb56bce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e48b1c-48ea-49d2-a3a6-b237bc568c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Volume 9a135f31-69f7-4f2c-b4e0-39d23371bdcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb', 'volume_size': 2} Jul 08 18:56:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:06 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57" returned: 0 in 5.082s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:06 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[961efdea-4967-4028-9e23-98165f55bd10]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:06 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:56:06 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:07 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.925s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:07 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:56:07 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Converted 1024.00 MB image at 201.45 MB/s Jul 08 18:56:07 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 is being set with open permissions: ugo+rw Jul 08 18:56:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:07 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 Jul 08 18:56:07 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:08 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57" returned: 0 in 0.628s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" released by "_copy_volume_from_snapshot" :: held 8.416s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-3995d438-6107-4f5e-9603-e37734b3ee57" released by "_create_volume_from_snapshot" :: held 8.454s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.471s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2047137247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a135f31-69f7-4f2c-b4e0-39d23371bdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52c6c14053243918236827a101b289d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:05Z,use_quota=True,user_id='1f489974f81d4a7885b8034daa6fda06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Creating volume 9a135f31-69f7-4f2c-b4e0-39d23371bdcb {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:08 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb 2147483648 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:08 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb 2147483648 Jul 08 18:56:08 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7942ae84-b31f-4c9b-b582-f26d4baee828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3995d438-6107-4f5e-9603-e37734b3ee57', 'volume_size': 1, 'snapshot_id': 'c56cc4d3-ce30-4b36-9d77-e0e935d18d1c'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff338b-dfeb-480b-8848-37c6758344fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Volume volume-3995d438-6107-4f5e-9603-e37734b3ee57 (3995d438-6107-4f5e-9603-e37734b3ee57): created successfully Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff338b-dfeb-480b-8848-37c6758344fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Flow 'volume_create_manager' (57910b4f-dfd3-4821-8bb4-9f616735eb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-29f18407-38c7-44de-ae15-3602862941a0 tempest-VolumesDeleteCascade-104518301 None] Created volume successfully. Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-37aa4fb2-6857-46b0-b39f-53c646f7d8e8-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-37aa4fb2-6857-46b0-b39f-53c646f7d8e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Performing cascade delete. {{(pid=87229) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Deleting offline snapshot c56cc4d3-ce30-4b36-9d77-e0e935d18d1c of volume 37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] snapshot_file for this snap is: volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61083a7b-a858-4de2-9f72-2de12eff0606]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:09 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:56:09 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:09 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb 2147483648" returned: 0 in 0.980s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:09 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb Jul 08 18:56:09 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:09 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.860s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f24e6-0517-4ed8-b782-db278d21a6bb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:09 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:56:09 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:10 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.193s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e48b1c-48ea-49d2-a3a6-b237bc568c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb', 'volume_size': 2}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d86c5-4ee4-4854-a133-60c7654a83e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe97239f-97c8-44e5-ba69-8d2d644be672]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Volume volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb (9a135f31-69f7-4f2c-b4e0-39d23371bdcb): created successfully Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d86c5-4ee4-4854-a133-60c7654a83e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Flow 'volume_create_manager' (28168c7b-e450-48d5-a2e9-7ed5c7713949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0a697d44-6a0d-407c-b9d4-567a019283b5 tempest-VolumesCloneNegativeTest-658625188 None] Created volume successfully. Jul 08 18:56:10 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 Jul 08 18:56:10 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Acquiring lock "cinder-9a135f31-69f7-4f2c-b4e0-39d23371bdcb-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "cinder-9a135f31-69f7-4f2c-b4e0-39d23371bdcb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Acquiring lock "cinder-quobyte-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "cinder-quobyte-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f4007-9996-4084-97fe-a474517715f4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:10 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.993s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:10 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb Jul 08 18:56:10 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:10 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:56:10 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:11 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039" returned: 0 in 0.931s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-8aec0538-8288-4448-840f-934a3ad73039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcd660b3-7cec-4055-996c-f26287c83e1f', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:56:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-6d24c4f7-d91f-462d-9025-707d996426f6 req-9e23c387-384f-48c2-9153-bf0a6bd88c32 tempest-TestStampPattern-329665916 None] attachment_update completed successfully. Jul 08 18:56:11 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:11 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb Jul 08 18:56:11 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:11 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.863s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:11 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c Jul 08 18:56:11 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:12 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" returned: 0 in 0.676s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "cinder-quobyte-9a135f31-69f7-4f2c-b4e0-39d23371bdcb" released by "delete_volume" :: held 1.577s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Created reservations ['b06b8956-ba48-4219-b1ae-04a94674d8c6', 'c21fe159-c47a-47e6-a604-e159fa31698d', '8197624d-6fd7-4971-955e-8f31faa3e00b', 'fc72e82e-8ea2-42dd-88e9-21d116f4a2b9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:12 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8.c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" returned: 0 in 0.713s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:12 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:12 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c" released by "_delete_snapshot" :: held 3.568s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" released by "delete_snapshot" :: held 3.590s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['96218005-3ebf-4453-8ec9-29d4ce3d391f', '16252876-a45b-4d30-af11-1ee7975aa4c3', '6757d022-03ab-4ca8-84aa-3191b44123ff', '89fa9f5b-4527-48b8-b6e4-032246a0c834'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Delete snapshot completed successfully. Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-c56cc4d3-ce30-4b36-9d77-e0e935d18d1c-delete_snapshot" released by "delete_snapshot" :: held 3.746s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Snapshots deleted, issuing volume delete {{(pid=87229) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ea66c-c40d-4b2e-b250-17d4415d690b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:12 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:56:12 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:13 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.697s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:13 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Deleted volume successfully. Jul 08 18:56:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b5ef7bb5-1b8c-4492-8776-2278cdb6ed01 tempest-VolumesCloneNegativeTest-658625188 None] Lock "cinder-9a135f31-69f7-4f2c-b4e0-39d23371bdcb-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:13 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.863s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:13 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8 Jul 08 18:56:13 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:14 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" returned: 0 in 0.712s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-37aa4fb2-6857-46b0-b39f-53c646f7d8e8" released by "delete_volume" :: held 1.633s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['fdd171e4-ad01-44e9-93ca-36c26edf2217', '55f87d04-3859-47c7-91aa-55c5260a2c2b', '947b3e86-2f24-4e62-a678-8ac630b2ecc2', '8ec20b56-7f51-4780-a0d9-c759f1f91756'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:14 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:14 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:15 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.707s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Deleted volume successfully. Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bc064eef-05ed-4551-b644-bc3feb3e1319 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-37aa4fb2-6857-46b0-b39f-53c646f7d8e8-delete_volume" released by "delete_volume" :: held 6.313s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-3995d438-6107-4f5e-9603-e37734b3ee57-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-3995d438-6107-4f5e-9603-e37734b3ee57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d13ec-15aa-4430-ab81-7b9a6e1ae9b1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:15 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 Jul 08 18:56:15 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (35288c1e-d8f7-4b01-bf18-ff886618082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34533ca7-84ad-4e3b-b3e4-17b3870a88fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34533ca7-84ad-4e3b-b3e4-17b3870a88fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-605061266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d5d1ff-733c-4ff3-86b5-07aeee857c7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:16Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f780ff83-3da2-4dc2-bcc7-993ad1c148c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f780ff83-3da2-4dc2-bcc7-993ad1c148c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8975b0-e6ba-435f-9d91-34ddd087c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8975b0-e6ba-435f-9d91-34ddd087c19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d5d1ff-733c-4ff3-86b5-07aeee857c7c', 'volume_name': 'volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e95dff0-8abf-4a10-90db-caf93c41f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e95dff0-8abf-4a10-90db-caf93c41f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769b26a-bfa2-48dc-8cb0-e3436d5b9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:16 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Volume 96d5d1ff-733c-4ff3-86b5-07aeee857c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c', 'volume_size': 1} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-605061266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d5d1ff-733c-4ff3-86b5-07aeee857c7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:16Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Creating volume 96d5d1ff-733c-4ff3-86b5-07aeee857c7c {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:16 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:16 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c 1073741824 Jul 08 18:56:16 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:16 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57" returned: 0 in 0.812s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:16 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57 Jul 08 18:56:16 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:16 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c 1073741824" returned: 0 in 0.872s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:17 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c Jul 08 18:56:17 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:17 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3995d438-6107-4f5e-9603-e37734b3ee57" returned: 0 in 0.721s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-quobyte-3995d438-6107-4f5e-9603-e37734b3ee57" released by "delete_volume" :: held 1.580s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Created reservations ['146d2ccf-6ed0-4ce9-9f21-cd17d89fc25b', '4e30affe-e251-4d23-b236-cd1dca7470fa', 'ad19b46f-4884-48b4-bb5c-5cb748bdb131', '9692dcfa-0736-4efd-b5cb-8bfb7123282a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:17 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:17 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:17 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" returned: 0 in 0.707s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769b26a-bfa2-48dc-8cb0-e3436d5b9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e3e74-2ea2-4ba2-9f4f-267b8304a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Volume volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c (96d5d1ff-733c-4ff3-86b5-07aeee857c7c): created successfully Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e3e74-2ea2-4ba2-9f4f-267b8304a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (35288c1e-d8f7-4b01-bf18-ff886618082e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a54eff2f-d864-48b9-b8fd-9d3fd1bb71b5 tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:56:18 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Deleted volume successfully. Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c18283b9-edd8-42c9-83e2-47078799d706 tempest-VolumesDeleteCascade-104518301 None] Lock "cinder-3995d438-6107-4f5e-9603-e37734b3ee57-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:18 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:18 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-c52a7bdd-eaa3-4f14-af2b-41fb20b90ac5 req-46eeacdd-cf8d-40d7-86be-50634b68c04c tempest-TestStampPattern-329665916 None] Terminate volume connection completed successfully. Jul 08 18:56:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-c52a7bdd-eaa3-4f14-af2b-41fb20b90ac5 req-46eeacdd-cf8d-40d7-86be-50634b68c04c tempest-TestStampPattern-329665916 None] Deleting attachment bcd660b3-7cec-4055-996c-f26287c83e1f. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:56:19 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.823s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (bf101a6a-aa69-4261-a9b1-f998cc508478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb64be0-c1ea-46fe-836d-806e46d78141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb64be0-c1ea-46fe-836d-806e46d78141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1077032450',display_name='tempest-VolumesGetTest-Volume-596788618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52d73f5-4598-4bfe-9c10-4e43158e769d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:19Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505e7ddc-d7d6-47dc-8907-b25422c6041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505e7ddc-d7d6-47dc-8907-b25422c6041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5bf8e-eede-44f5-bd82-f13b590f44b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5bf8e-eede-44f5-bd82-f13b590f44b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52d73f5-4598-4bfe-9c10-4e43158e769d', 'volume_name': 'volume-e52d73f5-4598-4bfe-9c10-4e43158e769d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8714a23d-c71d-47a2-a6b8-aa5b4609cf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8714a23d-c71d-47a2-a6b8-aa5b4609cf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df31a28-f159-4d07-8823-c2865675d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:19 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Volume e52d73f5-4598-4bfe-9c10-4e43158e769d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52d73f5-4598-4bfe-9c10-4e43158e769d', 'volume_size': 1} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1077032450',display_name='tempest-VolumesGetTest-Volume-596788618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52d73f5-4598-4bfe-9c10-4e43158e769d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:19Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Creating volume e52d73f5-4598-4bfe-9c10-4e43158e769d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:19 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:19 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d 1073741824 Jul 08 18:56:19 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:20 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d 1073741824" returned: 0 in 0.900s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:20 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d Jul 08 18:56:20 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:21 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d" returned: 0 in 0.716s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df31a28-f159-4d07-8823-c2865675d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52d73f5-4598-4bfe-9c10-4e43158e769d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d189e3-8e4f-40c8-bad5-98846143a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Flow 'volume_create_manager' (b2a2eab5-4cd6-415a-9ab7-99ea3ee6e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce472834-0da4-42c0-a410-37f064521ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Volume volume-e52d73f5-4598-4bfe-9c10-4e43158e769d (e52d73f5-4598-4bfe-9c10-4e43158e769d): created successfully Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d189e3-8e4f-40c8-bad5-98846143a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (bf101a6a-aa69-4261-a9b1-f998cc508478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce472834-0da4-42c0-a410-37f064521ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-952109140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c6ace1-1307-4c2f-85a5-5c0ff633cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55d3114e5a64056b017e18f512c447e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:21Z,use_quota=True,user_id='bee166f57b3d4ef4be5e6bff33ff1f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77e9ce3-111b-4807-8f45-18197f7ecd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77e9ce3-111b-4807-8f45-18197f7ecd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d385f6c-3322-413d-ba35-594ed3962759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d385f6c-3322-413d-ba35-594ed3962759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c6ace1-1307-4c2f-85a5-5c0ff633cb3d', 'volume_name': 'volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9ccc0-8237-44fe-b1f0-c9f015be59a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9ccc0-8237-44fe-b1f0-c9f015be59a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2009008b-231b-441a-95d7-b15b25ee92b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Volume 49c6ace1-1307-4c2f-85a5-5c0ff633cb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d', 'volume_size': 1} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-952109140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c6ace1-1307-4c2f-85a5-5c0ff633cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55d3114e5a64056b017e18f512c447e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:21Z,use_quota=True,user_id='bee166f57b3d4ef4be5e6bff33ff1f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Creating volume 49c6ace1-1307-4c2f-85a5-5c0ff633cb3d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:21 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e95dd076-8634-44f1-a0b0-9cfaa33b62e7 tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:56:21 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d 1073741824 Jul 08 18:56:21 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-e52d73f5-4598-4bfe-9c10-4e43158e769d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "cinder-e52d73f5-4598-4bfe-9c10-4e43158e769d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-e52d73f5-4598-4bfe-9c10-4e43158e769d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-e52d73f5-4598-4bfe-9c10-4e43158e769d" acquired by "delete_volume" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe80b07-1a54-4178-a0c4-0e198128df01]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:21 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d Jul 08 18:56:21 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:22 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d 1073741824" returned: 0 in 0.959s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:22 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d Jul 08 18:56:22 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:22 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d" returned: 0 in 0.856s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:22 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d Jul 08 18:56:22 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:22 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" returned: 0 in 0.763s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2009008b-231b-441a-95d7-b15b25ee92b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a1c12b-1f36-4374-b005-64a72f51a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Volume volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d (49c6ace1-1307-4c2f-85a5-5c0ff633cb3d): created successfully Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a1c12b-1f36-4374-b005-64a72f51a478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Flow 'volume_create_manager' (b2a2eab5-4cd6-415a-9ab7-99ea3ee6e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-46bb7c7b-d61e-4653-a465-5dd48cc16f29 tempest-VolumesMetadataTest-492955958 None] Created volume successfully. Jul 08 18:56:23 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e52d73f5-4598-4bfe-9c10-4e43158e769d" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-e52d73f5-4598-4bfe-9c10-4e43158e769d" released by "delete_volume" :: held 1.612s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Created reservations ['cf7ee9d2-ef83-47fe-912e-f83f6581514c', '7b92af95-f840-48d4-a032-204b7e057040', '80679716-8df4-4ef4-ae16-c1e09ceb9c45', '89cd5767-d794-4d78-994b-0d3ba77e4784'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:23 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:23 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-96d5d1ff-733c-4ff3-86b5-07aeee857c7c-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "cinder-96d5d1ff-733c-4ff3-86b5-07aeee857c7c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Acquiring lock "cinder-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" acquired by "delete_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "cinder-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41c5da-32c2-4aa3-94bd-f8f0de7b061c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Acquiring lock "cinder-quobyte-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "cinder-quobyte-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3b335-b48a-4349-9a40-98c117ecb6ee]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:24 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.957s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:56:24 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c Jul 08 18:56:24 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-69304309-a5f1-4011-a448-6bb1f88f6126 tempest-VolumesGetTest-1523976626 None] Lock "cinder-e52d73f5-4598-4bfe-9c10-4e43158e769d-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:24 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d Jul 08 18:56:24 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:25 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" returned: 0 in 0.940s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:25 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c Jul 08 18:56:25 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:25 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" returned: 0 in 0.982s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:25 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d Jul 08 18:56:25 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:25 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" returned: 0 in 0.679s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-96d5d1ff-733c-4ff3-86b5-07aeee857c7c" released by "delete_volume" :: held 1.694s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Created reservations ['76f19c44-7352-4388-903c-9e40e2c7078d', '5683c84a-4bfa-46c3-a709-226193d7fa93', '792914d2-378e-4ec8-8f3d-4d98cab695f2', '72d5b760-4671-4b0b-a346-bc96132a3d3d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:25 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" returned: 0 in 0.667s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "cinder-quobyte-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d" released by "delete_volume" :: held 1.693s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:26 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:26 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Created reservations ['56cf4844-b737-47a5-94f0-10ab5859e3a8', 'b260e901-5d0b-4b42-b5d8-85ec69f3cfae', '165f0692-00bc-4bc9-8174-499d1991c2d8', 'f8de7ae9-fa49-4212-adcb-4db71de70fb6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:26 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:26 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (8019e8f2-e6b6-4fab-ad39-dd2023d1378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdb4928-ead6-4086-8e0a-742f815f7439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdb4928-ead6-4086-8e0a-742f815f7439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1360437195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465e569c-e749-4b06-abc4-60f5405d9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:27Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:26 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ae5270-f6d6-43d4-9b74-c84382303bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ae5270-f6d6-43d4-9b74-c84382303bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1dda47-3fe1-4f38-a7f5-75f5e2d7ae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1dda47-3fe1-4f38-a7f5-75f5e2d7ae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465e569c-e749-4b06-abc4-60f5405d9bb7', 'volume_name': 'volume-465e569c-e749-4b06-abc4-60f5405d9bb7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b2c40-023f-48f4-99d2-33d7efbe9d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b2c40-023f-48f4-99d2-33d7efbe9d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65b7994-c19f-4422-af45-f1b807146b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:26 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Volume 465e569c-e749-4b06-abc4-60f5405d9bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465e569c-e749-4b06-abc4-60f5405d9bb7', 'volume_size': 1} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1360437195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465e569c-e749-4b06-abc4-60f5405d9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:27Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Creating volume 465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:26 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.006s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:56:27 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 1073741824 Jul 08 18:56:27 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:27 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.939s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3922e859-0d69-40d5-ad29-aea7015ff1bc tempest-VolumesGetTest-1523976626 None] Lock "cinder-96d5d1ff-733c-4ff3-86b5-07aeee857c7c-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Deleted volume successfully. Jul 08 18:56:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3202d07a-0f13-4280-87b3-cd0f430e2719 tempest-VolumesMetadataTest-492955958 None] Lock "cinder-49c6ace1-1307-4c2f-85a5-5c0ff633cb3d-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:28 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 1073741824" returned: 0 in 1.050s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:28 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:28 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:28 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.679s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65b7994-c19f-4422-af45-f1b807146b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465e569c-e749-4b06-abc4-60f5405d9bb7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a28dcf-0321-45e1-a1a5-1045b2db503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:28 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Volume volume-465e569c-e749-4b06-abc4-60f5405d9bb7 (465e569c-e749-4b06-abc4-60f5405d9bb7): created successfully Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a28dcf-0321-45e1-a1a5-1045b2db503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (8019e8f2-e6b6-4fab-ad39-dd2023d1378f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7bbe28a0-6dfb-49f2-9a41-894b6fdc3f7e tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-8aec0538-8288-4448-840f-934a3ad73039-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (80d1319f-af15-474a-ab20-d766da2a3b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c666ebcf-0533-4268-b34c-794e0aa96a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "cinder-8aec0538-8288-4448-840f-934a3ad73039-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c666ebcf-0533-4268-b34c-794e0aa96a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1210811664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5932d9f0-5f97-4210-b32f-2de136f7facc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=465e569c-e749-4b06-abc4-60f5405d9bb7,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:29Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176dc318-0850-47a6-b114-8bbb077ca5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176dc318-0850-47a6-b114-8bbb077ca5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487d6682-1399-4112-ae69-4a64fca5bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487d6682-1399-4112-ae69-4a64fca5bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5932d9f0-5f97-4210-b32f-2de136f7facc', 'volume_name': 'volume-5932d9f0-5f97-4210-b32f-2de136f7facc', 'volume_size': 1, 'source_volid': '465e569c-e749-4b06-abc4-60f5405d9bb7', 'source_volstatus': 'available'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea364a0d-77d9-4fff-a9fa-1f3e977f3d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea364a0d-77d9-4fff-a9fa-1f3e977f3d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826e10b9-e588-4b2b-b356-c4ef62643bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Volume 5932d9f0-5f97-4210-b32f-2de136f7facc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5932d9f0-5f97-4210-b32f-2de136f7facc', 'volume_size': 1, 'source_volid': '465e569c-e749-4b06-abc4-60f5405d9bb7', 'source_volstatus': 'available'} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:29 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Cloning volume 465e569c-e749-4b06-abc4-60f5405d9bb7 to volume 5932d9f0-5f97-4210-b32f-2de136f7facc Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Flow 'volume_create_manager' (7e09c66e-0583-4a9a-a643-babbfaf47bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef5e32-8d99-4362-8c41-bc031379973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc986a5d-da52-48fc-b486-38f18d690097]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Creating offline snapshot dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 of volume 465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0aaff5-3f5c-44ca-81e3-eeea1ee6d901]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef5e32-8d99-4362-8c41-bc031379973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1202038320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fa0275-e536-4080-9076-d1f475c9bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb68b5571b644d14ba193dac946cf8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:30Z,use_quota=True,user_id='f8c04cdb83b24bc69861dca68c69c2aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bc6596-23b0-449c-b3ea-0aba229dd4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bc6596-23b0-449c-b3ea-0aba229dd4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5226e8-b820-44c7-80e6-9b18b8f0c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 Jul 08 18:56:29 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5226e8-b820-44c7-80e6-9b18b8f0c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11fa0275-e536-4080-9076-d1f475c9bfd7', 'volume_name': 'volume-11fa0275-e536-4080-9076-d1f475c9bfd7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7c6cc-eb72-47e0-9f5a-dcfd79ebb035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7c6cc-eb72-47e0-9f5a-dcfd79ebb035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e5412a-7a65-49d2-aff9-adaa068b9249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:29 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Volume 11fa0275-e536-4080-9076-d1f475c9bfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11fa0275-e536-4080-9076-d1f475c9bfd7', 'volume_size': 1} Jul 08 18:56:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:29 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:29 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:30 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:30 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039 Jul 08 18:56:30 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:30 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.789s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:30 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 1G Jul 08 18:56:30 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:31 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8aec0538-8288-4448-840f-934a3ad73039" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-8aec0538-8288-4448-840f-934a3ad73039" released by "delete_volume" :: held 1.490s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Created reservations ['fd661ff5-7dc0-4a02-8654-0263fe1e2c24', '94244c83-0d6f-4e8d-b9b8-f188528b8809', 'e32469bc-5807-45f5-ac53-fc30e336df71', '37f63aa8-a9df-4965-a883-8d0f9fd38dbd'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:31 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:31 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:31 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 1G" returned: 0 in 0.844s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465e569c-e749-4b06-abc4-60f5405d9bb7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:31 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465e569c-e749-4b06-abc4-60f5405d9bb7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:31 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:32 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.693s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Deleted volume successfully. Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=75,cinder:UPDATE=98,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-4d289416-ec80-421b-b0e5-e91c81222e49 tempest-TestStampPattern-329665916 None] Lock "cinder-8aec0538-8288-4448-840f-934a3ad73039-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-5f8b8d31-0a24-40fd-a566-7debdfee5e49-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-5f8b8d31-0a24-40fd-a566-7debdfee5e49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Deleting offline snapshot 5f8b8d31-0a24-40fd-a566-7debdfee5e49 of volume 92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] snapshot_file for this snap is: volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[585494ec-639d-4cec-bd7d-bb6a50d58e59]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:32 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465e569c-e749-4b06-abc4-60f5405d9bb7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.760s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:32 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 is being set with open permissions: ugo+rw Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:32 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:32 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:32 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:56:32 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:32 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:32 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info Jul 08 18:56:32 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:32 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b736408-2840-44eb-a486-2c08b3f66e9c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:33 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:56:33 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:33 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info" returned: 0 in 0.651s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:33 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info is being set with open permissions: ugo+rw Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:33 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info Jul 08 18:56:33 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:33 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.803s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:33 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:56:33 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:34 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.info" returned: 0 in 0.647s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] snapshot: dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411, volume: 5932d9f0-5f97-4210-b32f-2de136f7facc, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c3f8c-7445-4ce2-8d6b-a6ccf0e99fde]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:34 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:34 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:34 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 0.763s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:34 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49 Jul 08 18:56:34 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:35 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.763s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465e569c-e749-4b06-abc4-60f5405d9bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[69892a2b-d396-4e0e-b7e1-a9a9bcfc50c7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:35 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:35 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:35 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb.5f8b8d31-0a24-40fd-a566-7debdfee5e49" returned: 0 in 0.679s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-5f8b8d31-0a24-40fd-a566-7debdfee5e49" released by "_delete_snapshot" :: held 3.150s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" released by "delete_snapshot" :: held 3.179s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Created reservations ['0a6e0956-9a02-40a5-9998-d862ad5a2ed3', 'e800d565-d746-40df-8550-4c3f903e11ae', '2985a201-59a4-4f31-b4ab-c587abb0beab', '6b325fb5-9dd5-4a75-8529-4cca74233a13'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:35 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Delete snapshot completed successfully. Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d74b17c4-6452-422c-bdad-a2e7a2b17957 tempest-TestStampPattern-329665916 None] Lock "cinder-5f8b8d31-0a24-40fd-a566-7debdfee5e49-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:35 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:56:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:35 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc Jul 08 18:56:35 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:41 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc" returned: 0 in 5.663s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0639b4b-6894-4742-a557-771b0e5816ab]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:41 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:41 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:42 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 1.046s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:42 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:56:42 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Converted 1024.00 MB image at 180.77 MB/s Jul 08 18:56:42 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc is being set with open permissions: ugo+rw Jul 08 18:56:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:42 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc Jul 08 18:56:42 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:43 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc" returned: 0 in 0.634s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" released by "_copy_volume_from_snapshot" :: held 8.966s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Deleting offline snapshot dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 of volume 465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] snapshot_file for this snap is: volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cddd355-761d-4d06-9aaf-9b317e3f9edf]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:43 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:43 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:44 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.795s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465e569c-e749-4b06-abc4-60f5405d9bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d6a1ff-6d86-43c6-a5db-fd3837dae165]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:44 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:44 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:44 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:44 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:44 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:45 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=83,cinder:INSERT=28,cinder:UPDATE=97,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:56:45 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.767s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:45 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411 Jul 08 18:56:45 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "cinder-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Acquiring lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:46 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7.dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" returned: 0 in 0.696s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e4d71-c39e-4db6-b566-7883f7d65184]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-dbbb95fe-5dc3-4d9f-ad1d-2183f5b07411" released by "_delete_snapshot" :: held 3.098s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.686s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.444s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1202038320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fa0275-e536-4080-9076-d1f475c9bfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb68b5571b644d14ba193dac946cf8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:30Z,use_quota=True,user_id='f8c04cdb83b24bc69861dca68c69c2aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Creating volume 11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:46 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826e10b9-e588-4b2b-b356-c4ef62643bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5932d9f0-5f97-4210-b32f-2de136f7facc', 'volume_size': 1, 'source_volid': '465e569c-e749-4b06-abc4-60f5405d9bb7', 'source_volstatus': 'available'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2d7e56-4fd9-4921-8e21-1d0efb358bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:46 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 1073741824 Jul 08 18:56:46 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Volume volume-5932d9f0-5f97-4210-b32f-2de136f7facc (5932d9f0-5f97-4210-b32f-2de136f7facc): created successfully Jul 08 18:56:46 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:56:46 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2d7e56-4fd9-4921-8e21-1d0efb358bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:46 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (80d1319f-af15-474a-ab20-d766da2a3b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-96939189-5c78-41dd-aa21-6ce026c396d3 tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:56:47 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.820s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:47 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb Jul 08 18:56:47 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:47 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 1073741824" returned: 0 in 0.939s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:47 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:56:47 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (542f9296-640a-43ee-baa7-c5c93b0487e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5322fd68-1f60-4d1c-8fcd-a5457be03079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5322fd68-1f60-4d1c-8fcd-a5457be03079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1086083374',display_name='tempest-VolumesGetTest-Volume-2016619879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018f344-7dec-4bf2-aa3e-0e3491d51a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:48Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ebd00e-766a-4493-9d1d-77642794ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ebd00e-766a-4493-9d1d-77642794ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a204c0f-5c65-488f-bf08-c50f04aa2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a204c0f-5c65-488f-bf08-c50f04aa2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e018f344-7dec-4bf2-aa3e-0e3491d51a0a', 'volume_name': 'volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f778394-2f54-4c57-be6f-912b0131a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f778394-2f54-4c57-be6f-912b0131a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d5c6a6-2403-4f63-9d5b-8c20961d0eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:47 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Volume e018f344-7dec-4bf2-aa3e-0e3491d51a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a', 'volume_size': 1} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:47 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "cinder-quobyte-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb" released by "delete_volume" :: held 1.581s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Created reservations ['6ce7b1cd-71fa-42fd-b226-6aab0884f493', '379a1be5-ab1f-4113-950e-fafc5936fad3', '825f0eec-f6b6-4de5-95e6-20db8b7c8622', 'c346b820-e6df-43a7-b014-20f42419d68f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:48 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:48 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:48 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.678s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1086083374',display_name='tempest-VolumesGetTest-Volume-2016619879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018f344-7dec-4bf2-aa3e-0e3491d51a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:48Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Creating volume e018f344-7dec-4bf2-aa3e-0e3491d51a0a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:56:48 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:48 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a 1073741824 Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e5412a-7a65-49d2-aff9-adaa068b9249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11fa0275-e536-4080-9076-d1f475c9bfd7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2190643-9538-45d7-b1f7-04d595380281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Volume volume-11fa0275-e536-4080-9076-d1f475c9bfd7 (11fa0275-e536-4080-9076-d1f475c9bfd7): created successfully Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2190643-9538-45d7-b1f7-04d595380281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Flow 'volume_create_manager' (7e09c66e-0583-4a9a-a643-babbfaf47bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-db7f2518-b974-4ea9-93cf-69e01a79650e tempest-VolumesCloneTest-1128070094 None] Created volume successfully. Jul 08 18:56:48 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Deleted volume successfully. Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-23684c48-9e40-4ffa-ae89-a38aef471b5c tempest-TestStampPattern-329665916 None] Lock "cinder-92dbc0b4-f42e-49e8-b457-aa3f5bc636cb-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Flow 'volume_create_manager' (7e2dec9d-b8ca-46b4-8339-2bfca8c7fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4b3b5e-338b-463d-a9f4-77ee78593108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4b3b5e-338b-463d-a9f4-77ee78593108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-292931344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9395ecb9-32ab-420d-a612-094049c671d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb68b5571b644d14ba193dac946cf8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:56:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=11fa0275-e536-4080-9076-d1f475c9bfd7,status='creating',terminated_at=None,updated_at=2026-07-08T16:56:49Z,use_quota=True,user_id='f8c04cdb83b24bc69861dca68c69c2aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2893ee8f-686b-4c37-8d5c-c5c3a96e3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2893ee8f-686b-4c37-8d5c-c5c3a96e3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa89b12e-7db9-47c1-807a-b2ea0db7f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa89b12e-7db9-47c1-807a-b2ea0db7f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9395ecb9-32ab-420d-a612-094049c671d4', 'volume_name': 'volume-9395ecb9-32ab-420d-a612-094049c671d4', 'volume_size': 2, 'source_volid': '11fa0275-e536-4080-9076-d1f475c9bfd7', 'source_volstatus': 'available'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab1b39-940f-483f-88e0-69a0978bd7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab1b39-940f-483f-88e0-69a0978bd7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7329923-dd43-42c5-ad5e-dab583be3897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:49 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Volume 9395ecb9-32ab-420d-a612-094049c671d4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9395ecb9-32ab-420d-a612-094049c671d4', 'volume_size': 2, 'source_volid': '11fa0275-e536-4080-9076-d1f475c9bfd7', 'source_volstatus': 'available'} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:49 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a 1073741824" returned: 0 in 1.055s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:49 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a Jul 08 18:56:49 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:49 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" returned: 0 in 0.676s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.797s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:49 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Cloning volume 11fa0275-e536-4080-9076-d1f475c9bfd7 to volume 9395ecb9-32ab-420d-a612-094049c671d4 Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d5c6a6-2403-4f63-9d5b-8c20961d0eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee606f5e-84b9-4304-91b7-4c1350dbe14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:56:49 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Volume volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a (e018f344-7dec-4bf2-aa3e-0e3491d51a0a): created successfully Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee606f5e-84b9-4304-91b7-4c1350dbe14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (542f9296-640a-43ee-baa7-c5c93b0487e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Creating offline snapshot 2a798c8c-e30d-46e0-bfe0-e85bc0152583 of volume 11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:56:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-485fa72e-ec73-41b7-bb5f-8528a1fe2d7f tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f980ad-9476-4923-8dab-6ff2fe933894]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:50 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:56:50 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:50 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.835s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:50 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 1G Jul 08 18:56:50 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-e018f344-7dec-4bf2-aa3e-0e3491d51a0a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "cinder-e018f344-7dec-4bf2-aa3e-0e3491d51a0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4db10b-137e-4753-99f3-d0d7041dd7f0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:51 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a Jul 08 18:56:51 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:51 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 1G" returned: 0 in 0.911s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fa0275-e536-4080-9076-d1f475c9bfd7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:51 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fa0275-e536-4080-9076-d1f475c9bfd7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:56:51 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:52 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" returned: 0 in 1.008s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:52 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a Jul 08 18:56:52 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:52 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11fa0275-e536-4080-9076-d1f475c9bfd7 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.812s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:52 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 is being set with open permissions: ugo+rw Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:52 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:56:52 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:52 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-e018f344-7dec-4bf2-aa3e-0e3491d51a0a" released by "delete_volume" :: held 1.832s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Created reservations ['91ee7391-6aee-425c-8a37-29a2f1d3c952', '8e710832-8def-4c1f-8f37-dc3d0f38c858', 'f13c3d4e-c21a-47c6-8a7f-fb6755645923', '085f1702-a606-47e6-ba9b-67f262d7b3a7'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:53 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:53 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-5932d9f0-5f97-4210-b32f-2de136f7facc-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-5932d9f0-5f97-4210-b32f-2de136f7facc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f70d9aa-9ee0-4625-8073-96eb5e417244]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:53 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.879s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:53 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info Jul 08 18:56:53 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:53 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc Jul 08 18:56:53 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:53 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:56:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f91121d6-ec3c-488d-8610-e8b99d7e6369 tempest-VolumesGetTest-1523976626 None] Lock "cinder-e018f344-7dec-4bf2-aa3e-0e3491d51a0a-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:54 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info" returned: 0 in 0.803s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:54 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info is being set with open permissions: ugo+rw Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:54 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc" returned: 0 in 0.899s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:54 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info Jul 08 18:56:54 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:54 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc Jul 08 18:56:54 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:54 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-5932d9f0-5f97-4210-b32f-2de136f7facc" returned: 0 in 0.726s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:54 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.info" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-5932d9f0-5f97-4210-b32f-2de136f7facc" released by "delete_volume" :: held 1.691s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] snapshot: 2a798c8c-e30d-46e0-bfe0-e85bc0152583, volume: 9395ecb9-32ab-420d-a612-094049c671d4, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d02c9e-21df-41c8-8384-58ad878e651e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Created reservations ['16965427-442a-4584-9e59-c194050296fe', '28d9f17f-4901-4189-b13b-d69cb586bf8f', 'c3dd447e-2641-4fde-b9f4-2f4ea469a6e5', 'f78432ab-690d-4bf3-b936-ed9e0c6b8743'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:55 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:56:55 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:55 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:55 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-465e569c-e749-4b06-abc4-60f5405d9bb7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "cinder-465e569c-e749-4b06-abc4-60f5405d9bb7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-465e569c-e749-4b06-abc4-60f5405d9bb7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-465e569c-e749-4b06-abc4-60f5405d9bb7" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84d94f1-9720-4bf6-b827-9aeffe5c4adf]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:55 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:55 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:55 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.915s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fa0275-e536-4080-9076-d1f475c9bfd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610c3f4-355b-489f-ae81-d68f0a51eead]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:56 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.901s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-73643b71-01d2-4c7c-b952-93b6898eacf3 tempest-VolumesGetTest-1523976626 None] Lock "cinder-5932d9f0-5f97-4210-b32f-2de136f7facc-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:56 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:56:56 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:56 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.924s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:56 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7 Jul 08 18:56:56 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:56 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.931s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:56:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:57 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 Jul 08 18:56:57 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:57 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-465e569c-e749-4b06-abc4-60f5405d9bb7" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-465e569c-e749-4b06-abc4-60f5405d9bb7" released by "delete_volume" :: held 1.750s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Created reservations ['fd501ca3-d7f6-4bba-ad91-9223d799b01e', '40f01d6e-cec6-4c31-9da8-e30c1f1562c9', '06d79f7b-faf5-4d8b-931d-68e5095b1276', 'c32caa5d-6996-49a2-a7fe-b445c0ba4fa3'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:56:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:56:57 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:56:57 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:56:58 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 08 18:56:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.804s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:56:58 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:56:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:56:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3d550de-f224-430a-aa7c-be7f6fa65a6a tempest-VolumesGetTest-1523976626 None] Lock "cinder-465e569c-e749-4b06-abc4-60f5405d9bb7-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:00 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (a0f7e1d6-a3d5-42eb-a5c1-24c4d2df34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384feb83-f301-42b2-b3d7-df89eab71f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384feb83-f301-42b2-b3d7-df89eab71f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-805755007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67930e8-2c2d-45c6-930d-8f66f6effcd6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:01Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73925300-0286-4c9b-a30b-2f564ce8074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73925300-0286-4c9b-a30b-2f564ce8074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b781f2e8-5fac-4894-8a91-8c7750b4a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b781f2e8-5fac-4894-8a91-8c7750b4a842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f67930e8-2c2d-45c6-930d-8f66f6effcd6', 'volume_name': 'volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51cab7f-c347-434b-88a9-35bc996bdd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51cab7f-c347-434b-88a9-35bc996bdd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c953364-4965-46e5-9e7d-552b9a72252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Volume f67930e8-2c2d-45c6-930d-8f66f6effcd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:57:01 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Trying to clone f67930e8-2c2d-45c6-930d-8f66f6effcd6 from image dd434acf-5aa9-44c3-8328-d41e2c476c9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:57:02 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02740043-e6a2-4d94-99c2-3a4efed5c9c1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:02 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:02 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD Jul 08 18:57:02 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4" returned: 0 in 5.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e62c3f7-dd85-4ded-9342-a092172332ff]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:03 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:57:03 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:03 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:03 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a is fetched for user 1ab3f24d224645808f48b61a05c4560d. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:57:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26638af7-0226-4304-832f-c7fc7cce7023]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:03 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD Jul 08 18:57:03 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:04 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 1.034s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:04 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Converted 1024.00 MB image at 171.08 MB/s Jul 08 18:57:04 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 is being set with open permissions: ugo+rw Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:04 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 Jul 08 18:57:04 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:04 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:04 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" released by "_copy_volume_from_snapshot" :: held 9.674s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-quobyte-2a798c8c-e30d-46e0-bfe0-e85bc0152583" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-2a798c8c-e30d-46e0-bfe0-e85bc0152583" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Deleting offline snapshot 2a798c8c-e30d-46e0-bfe0-e85bc0152583 of volume 11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] snapshot_file for this snap is: volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983ea13-4287-4658-b6af-d13bdf33c444]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:04 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:57:04 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:05 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11fa0275-e536-4080-9076-d1f475c9bfd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf2004a-f2fa-4449-871a-5cdcb87ff68d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:05 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:57:05 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.790s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:06 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:57:06 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:06 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Flow 'volume_create_manager' (30e6e43d-ecf3-47b9-9522-7035368cb0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd123156-790a-40b1-96ce-82c78e74d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd123156-790a-40b1-96ce-82c78e74d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a628ace1-91ac-4d66-b627-aab574ebb5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d4dfd2f2c4928a0c02ed743f006cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:07Z,use_quota=True,user_id='ee01e9030ddd419d81a10e577d3abb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fe8faa-f3cd-4035-a98f-19824c01010b),volume_type_id=54fe8faa-f3cd-4035-a98f-19824c01010b)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f88ed0f-410b-420d-8923-5cc63bd0d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f88ed0f-410b-420d-8923-5cc63bd0d563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b61538-fc5d-49ed-9c2f-f2c7c06ae945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:57:07 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583 Jul 08 18:57:07 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b61538-fc5d-49ed-9c2f-f2c7c06ae945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a628ace1-91ac-4d66-b627-aab574ebb5ec', 'volume_name': 'volume-a628ace1-91ac-4d66-b627-aab574ebb5ec', 'volume_size': 1, 'image_id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db83f6c3f8140eac13e3c885e5cc6607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b08d4dfd2f2c4928a0c02ed743f006cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d365b39707c3448b1257771fc2364e433814ffb7214a92f9d6bc9cc254aaaefb6ce17b91bbaf3525002ae07b7a2566f0b9d6f5e74ad191cb43b84aa4a9f0b2', 'id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758dcc03-d4fa-4963-baac-cf357090d60b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5bd22c-541b-44db-81aa-c0e4e69c8641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5bd22c-541b-44db-81aa-c0e4e69c8641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1639a6-aa32-4871-ab1c-bb274b256562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Volume a628ace1-91ac-4d66-b627-aab574ebb5ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a628ace1-91ac-4d66-b627-aab574ebb5ec', 'volume_size': 1, 'image_id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db83f6c3f8140eac13e3c885e5cc6607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b08d4dfd2f2c4928a0c02ed743f006cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d365b39707c3448b1257771fc2364e433814ffb7214a92f9d6bc9cc254aaaefb6ce17b91bbaf3525002ae07b7a2566f0b9d6f5e74ad191cb43b84aa4a9f0b2', 'id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758dcc03-d4fa-4963-baac-cf357090d60b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Trying to clone a628ace1-91ac-4d66-b627-aab574ebb5ec from image 758dcc03-d4fa-4963-baac-cf357090d60b at location (None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:57:07 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b502dfd3-75e2-4a7e-970f-5ec88dc2daa0]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:07 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7.2a798c8c-e30d-46e0-bfe0-e85bc0152583" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-2a798c8c-e30d-46e0-bfe0-e85bc0152583" released by "_delete_snapshot" :: held 3.108s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.056s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.407s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-805755007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67930e8-2c2d-45c6-930d-8f66f6effcd6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:01Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Creating volume f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:07 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7329923-dd43-42c5-ad5e-dab583be3897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9395ecb9-32ab-420d-a612-094049c671d4', 'volume_size': 2, 'source_volid': '11fa0275-e536-4080-9076-d1f475c9bfd7', 'source_volstatus': 'available'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1073741824 Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7981dc-23db-4bd3-b1d3-bae6d9353d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:07 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Volume volume-9395ecb9-32ab-420d-a612-094049c671d4 (9395ecb9-32ab-420d-a612-094049c671d4): created successfully Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7981dc-23db-4bd3-b1d3-bae6d9353d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Flow 'volume_create_manager' (7e2dec9d-b8ca-46b4-8339-2bfca8c7fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-67373e18-5163-47d4-b6a2-0ff56beaa738 tempest-VolumesCloneTest-1128070094 None] Created volume successfully. Jul 08 18:57:08 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:08 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:08 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:08 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1073741824" returned: 0 in 0.848s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:08 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:08 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-9395ecb9-32ab-420d-a612-094049c671d4-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "cinder-9395ecb9-32ab-420d-a612-094049c671d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:08 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Temporary image 758dcc03-d4fa-4963-baac-cf357090d60b is fetched for user ee01e9030ddd419d81a10e577d3abb0b. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:57:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229918d-19a3-4f28-9f91-6a1e1e7db1dd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b54ca-d8e9-49e6-bfa9-826c7758f3d3]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 Jul 08 18:57:09 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:09 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 0 in 0.747s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Attempting download of dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume f67930e8-2c2d-45c6-930d-8f66f6effcd6. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99c2b0-54a4-49fc-9dc4-d317d7c4b7d3]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n Jul 08 18:57:09 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4" returned: 0 in 0.800s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:09 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4 Jul 08 18:57:09 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:09 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:09 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n" returned: 0 in 0.762s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9395ecb9-32ab-420d-a612-094049c671d4" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-9395ecb9-32ab-420d-a612-094049c671d4" released by "delete_volume" :: held 1.543s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:10 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 1 in 0.728s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a628ace1-91ac-4d66-b627-aab574ebb5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d4dfd2f2c4928a0c02ed743f006cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:07Z,use_quota=True,user_id='ee01e9030ddd419d81a10e577d3abb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fe8faa-f3cd-4035-a98f-19824c01010b),volume_type_id=54fe8faa-f3cd-4035-a98f-19824c01010b)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:10 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n Jul 08 18:57:10 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Creating volume a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:10 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1073741824 Jul 08 18:57:10 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Created reservations ['b703b842-30d4-4502-9311-a7fabec6a55d', '07c59f4d-fa20-443f-9b1d-bdd51532d119', '11de2df5-99e0-43b0-888f-9766696e0df9', '6ed6fc5b-f53d-40c5-a3ea-d053aa84b2e5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:10 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:10 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n" returned: 1 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_k5r5x01n' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5772690-b844-4dc1-965f-d61aac7f1314]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-11fa0275-e536-4080-9076-d1f475c9bfd7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:11 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD Jul 08 18:57:11 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "cinder-11fa0275-e536-4080-9076-d1f475c9bfd7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Acquiring lock "cinder-quobyte-11fa0275-e536-4080-9076-d1f475c9bfd7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-11fa0275-e536-4080-9076-d1f475c9bfd7" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca90a37-d0c2-48e1-bdff-ff63cbb80096]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1073741824" returned: 0 in 1.041s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.922s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Deleted volume successfully. Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:11 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:57:11 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-20596e8f-3a42-4273-bde9-4fb02cf9f1af tempest-VolumesCloneTest-1128070094 None] Lock "cinder-9395ecb9-32ab-420d-a612-094049c671d4-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:11 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:11 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] dd434acf-5aa9-44c3-8328-d41e2c476c9a was qcow2, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:12 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.817s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 0 in 0.701s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:12 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7 Jul 08 18:57:12 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Attempting download of 758dcc03-d4fa-4963-baac-cf357090d60b ((None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}])) to volume a628ace1-91ac-4d66-b627-aab574ebb5ec. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d700e9-6209-4493-ba72-34b2bf866f12]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:12 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg Jul 08 18:57:12 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:13 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-11fa0275-e536-4080-9076-d1f475c9bfd7" returned: 0 in 0.709s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "cinder-quobyte-11fa0275-e536-4080-9076-d1f475c9bfd7" released by "delete_volume" :: held 1.596s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Created reservations ['e69eb215-4338-43ac-9596-17587fb3b06f', 'e7a09a4d-c61e-412e-aa2d-b4ef5cf52b7e', '9dc880e7-f1ab-492f-be3a-3eb6c0a9b14f', 'ea919035-2b70-4a36-8cd0-86c57d05127e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:13 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:13 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:13 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:13 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg Jul 08 18:57:13 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:14 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Deleted volume successfully. Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ab1f910c-b0e0-4b07-98df-88ee0ddbda1b tempest-VolumesCloneTest-1128070094 None] Lock "cinder-11fa0275-e536-4080-9076-d1f475c9bfd7-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:14 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg" returned: 1 in 0.942s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_758dcc03-d4fa-4963-baac-cf357090d60b_kzaacckg' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[259adb0b-4376-44a4-a7b6-81c47b1d2bfc]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 0 in 2.172s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_7nhqyrnxdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:14 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Converted 112.00 MB image at 51.49 MB/s Jul 08 18:57:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:14 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1G Jul 08 18:57:14 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:14 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:14 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 1G" returned: 0 in 0.778s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c7bb7-d735-4693-9d95-9887bd242eb4]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 0 in 0.941s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:15 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD Jul 08 18:57:15 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:15 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD" returned: 1 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] 758dcc03-d4fa-4963-baac-cf357090d60b was raw, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:57:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:15 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:15 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:16 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 1 in 0.830s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Downloaded image dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume f67930e8-2c2d-45c6-930d-8f66f6effcd6 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a for user 1ab3f24d224645808f48b61a05c4560d is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Marking volume f67930e8-2c2d-45c6-930d-8f66f6effcd6 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Copying metadata from image dd434acf-5aa9-44c3-8328-d41e2c476c9a to f67930e8-2c2d-45c6-930d-8f66f6effcd6. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Creating volume glance metadata for volume f67930e8-2c2d-45c6-930d-8f66f6effcd6 backed by image dd434acf-5aa9-44c3-8328-d41e2c476c9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:57:16 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_758dcc03-d4fa-4963-baac-cf357090d60b_hi9l3e0qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:16 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:16 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1G Jul 08 18:57:16 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c953364-4965-46e5-9e7d-552b9a72252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0288-2d0b-457a-a061-0eaf49c8af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:16 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Volume volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 (f67930e8-2c2d-45c6-930d-8f66f6effcd6): created successfully Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0288-2d0b-457a-a061-0eaf49c8af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:16 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (a0f7e1d6-a3d5-42eb-a5c1-24c4d2df34ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7749c72b-8718-4c35-8159-ac3df105c135 tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Flow 'volume_create_manager' (8e261ecf-423e-42bc-8359-df68b5b19a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f1784b-636f-4cbb-ba1e-238427a4694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f1784b-636f-4cbb-ba1e-238427a4694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-515039476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2de5b47-ec30-4df6-a417-721638be8785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f2e6fb79e4ab9b369d5b404e8ea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:17Z,use_quota=True,user_id='c54cd5d0d4be41fba7b7550ceea4eee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a5de56-4341-4e39-841c-0cd0f4820d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a5de56-4341-4e39-841c-0cd0f4820d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969596bd-938a-47a7-a259-04f6ae4a1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969596bd-938a-47a7-a259-04f6ae4a1d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2de5b47-ec30-4df6-a417-721638be8785', 'volume_name': 'volume-d2de5b47-ec30-4df6-a417-721638be8785', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7421a5-c94e-4235-bc91-fdb4582a1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:17 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7421a5-c94e-4235-bc91-fdb4582a1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccad93db-4c42-4f37-bc53-b0f429bf1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Volume d2de5b47-ec30-4df6-a417-721638be8785: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2de5b47-ec30-4df6-a417-721638be8785', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Trying to clone d2de5b47-ec30-4df6-a417-721638be8785 from image dd434acf-5aa9-44c3-8328-d41e2c476c9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec 1G" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a692c17-8896-41a7-9fe1-90a4b5b702e8]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:17 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:17 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:17 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:57:17 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ae9e72-2dd3-4c29-8952-eb11a2721c29]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD Jul 08 18:57:18 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:18 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:18 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 0 in 1.011s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:18 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:18 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (49bb4ff6-64fa-4bc0-a947-4cfd02ab8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f419034f-84b9-4665-83d3-3ca4796cfd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f419034f-84b9-4665-83d3-3ca4796cfd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435756163',display_name='tempest-VolumesGetTest-Volume-165018719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269f3ac-2ae0-4227-ac72-73469f9d118a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:19Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb5520a-5be5-4ed9-8350-a0c4b14b4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb5520a-5be5-4ed9-8350-a0c4b14b4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7022758-c35e-4d18-a688-a8d16241bc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7022758-c35e-4d18-a688-a8d16241bc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b269f3ac-2ae0-4227-ac72-73469f9d118a', 'volume_name': 'volume-b269f3ac-2ae0-4227-ac72-73469f9d118a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca16435b-d240-477e-88d6-cb0442da1424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca16435b-d240-477e-88d6-cb0442da1424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1684dcfc-55c6-4d03-9df2-f584c52967d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:18 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Volume b269f3ac-2ae0-4227-ac72-73469f9d118a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b269f3ac-2ae0-4227-ac72-73469f9d118a', 'volume_size': 1} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-435756163',display_name='tempest-VolumesGetTest-Volume-165018719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269f3ac-2ae0-4227-ac72-73469f9d118a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f60890a105e407eaaaf2fbef727b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:19Z,use_quota=True,user_id='1ab3f24d224645808f48b61a05c4560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Creating volume b269f3ac-2ae0-4227-ac72-73469f9d118a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:18 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:18 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a 1073741824 Jul 08 18:57:18 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:18 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD" returned: 0 in 0.927s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:18 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a is fetched for user c54cd5d0d4be41fba7b7550ceea4eee9. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:57:19 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.807s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a20efd-1b17-49c0-915f-8a9f57778854]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:19 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD Jul 08 18:57:19 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:19 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 1 in 0.863s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Downloaded image 758dcc03-d4fa-4963-baac-cf357090d60b ((None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}])) to volume a628ace1-91ac-4d66-b627-aab574ebb5ec successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Temporary image 758dcc03-d4fa-4963-baac-cf357090d60b for user ee01e9030ddd419d81a10e577d3abb0b is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Marking volume a628ace1-91ac-4d66-b627-aab574ebb5ec as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Copying metadata from image 758dcc03-d4fa-4963-baac-cf357090d60b to a628ace1-91ac-4d66-b627-aab574ebb5ec. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Creating volume glance metadata for volume a628ace1-91ac-4d66-b627-aab574ebb5ec backed by image 758dcc03-d4fa-4963-baac-cf357090d60b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'db83f6c3f8140eac13e3c885e5cc6607', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1639a6-aa32-4871-ab1c-bb274b256562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a628ace1-91ac-4d66-b627-aab574ebb5ec', 'volume_size': 1, 'image_id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/758dcc03-d4fa-4963-baac-cf357090d60b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db83f6c3f8140eac13e3c885e5cc6607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b08d4dfd2f2c4928a0c02ed743f006cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d365b39707c3448b1257771fc2364e433814ffb7214a92f9d6bc9cc254aaaefb6ce17b91bbaf3525002ae07b7a2566f0b9d6f5e74ad191cb43b84aa4a9f0b2', 'id': '758dcc03-d4fa-4963-baac-cf357090d60b', 'created_at': datetime.datetime(2026, 7, 8, 16, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 57, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/758dcc03-d4fa-4963-baac-cf357090d60b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dad7478-99a5-4bc6-bde9-071ed5b58310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:19 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Volume volume-a628ace1-91ac-4d66-b627-aab574ebb5ec (a628ace1-91ac-4d66-b627-aab574ebb5ec): created successfully Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dad7478-99a5-4bc6-bde9-071ed5b58310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Flow 'volume_create_manager' (30e6e43d-ecf3-47b9-9522-7035368cb0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dafec2ec-839a-45c6-a6f2-8ed36dfb07a3 tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Created volume successfully. Jul 08 18:57:19 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:19 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a 1073741824" returned: 0 in 1.019s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Acquiring lock "cinder-a628ace1-91ac-4d66-b627-aab574ebb5ec-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:19 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a Jul 08 18:57:19 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "cinder-a628ace1-91ac-4d66-b627-aab574ebb5ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Acquiring lock "cinder-quobyte-a628ace1-91ac-4d66-b627-aab574ebb5ec" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "cinder-quobyte-a628ace1-91ac-4d66-b627-aab574ebb5ec" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d1236c-02d9-44d4-9e3f-bee5599cf92f]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:20 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:20 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:20 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a" returned: 0 in 0.708s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-515039476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2de5b47-ec30-4df6-a417-721638be8785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f2e6fb79e4ab9b369d5b404e8ea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:17Z,use_quota=True,user_id='c54cd5d0d4be41fba7b7550ceea4eee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Creating volume d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:20 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:20 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1073741824 Jul 08 18:57:20 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1684dcfc-55c6-4d03-9df2-f584c52967d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b269f3ac-2ae0-4227-ac72-73469f9d118a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae3ee34-f7c7-4a84-8561-6e28ccd749eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:20 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Volume volume-b269f3ac-2ae0-4227-ac72-73469f9d118a (b269f3ac-2ae0-4227-ac72-73469f9d118a): created successfully Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae3ee34-f7c7-4a84-8561-6e28ccd749eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Flow 'volume_create_manager' (49bb4ff6-64fa-4bc0-a947-4cfd02ab8d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-076beda4-22e0-4a65-8d67-48dd983a13ef tempest-VolumesGetTest-1523976626 None] Created volume successfully. Jul 08 18:57:20 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:20 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:20 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:21 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1073741824" returned: 0 in 0.888s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:21 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:21 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:21 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 1 in 0.777s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:21 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec Jul 08 18:57:21 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-b269f3ac-2ae0-4227-ac72-73469f9d118a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "cinder-b269f3ac-2ae0-4227-ac72-73469f9d118a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-b269f3ac-2ae0-4227-ac72-73469f9d118a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-b269f3ac-2ae0-4227-ac72-73469f9d118a" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1dafb5-87fd-4ea9-8a92-183c60c553d4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:22 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a Jul 08 18:57:22 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:22 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Attempting download of dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume d2de5b47-ec30-4df6-a417-721638be8785. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:57:22 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a628ace1-91ac-4d66-b627-aab574ebb5ec" returned: 0 in 0.747s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "cinder-quobyte-a628ace1-91ac-4d66-b627-aab574ebb5ec" released by "delete_volume" :: held 2.375s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e324e1f-d33a-40f8-b1a1-e9eb9031afea]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:22 devstack cinder-volume[87229]: WARNING cinder.quota [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:57:22 devstack cinder-volume[87229]: WARNING cinder.quota [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Created reservations ['f447d0a6-0366-4e0f-bcb5-bf2e1c7ba355', 'e19a31f9-1b8d-40c1-839b-b2901eea391d', '6c3b1eb3-1265-4768-af25-5141804e367f', '726de458-a1e0-419b-afaa-a512eca028c8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:22 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0 Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:22 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:22 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:22 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:22 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a" returned: 0 in 0.830s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:23 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a Jul 08 18:57:23 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:23 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:23 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0" returned: 0 in 0.861s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Deleted volume successfully. Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-21e9ddec-45a9-43ed-91c8-56d9d852c54d tempest-VolumeAndVolumeTypeFromImageTest-1732139769 None] Lock "cinder-a628ace1-91ac-4d66-b627-aab574ebb5ec-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:23 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0 Jul 08 18:57:23 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:23 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b269f3ac-2ae0-4227-ac72-73469f9d118a" returned: 0 in 0.698s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-b269f3ac-2ae0-4227-ac72-73469f9d118a" released by "delete_volume" :: held 1.592s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Created reservations ['ec161907-cf02-4ce5-8830-0a52c710294f', 'b7c42a5f-de35-409e-b9b1-2e75020fde3a', 'e3fe057a-221b-40e6-a1ed-b01fc86876e7', 'cad7e46c-8269-4165-ab61-2f45f6892077'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:23 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:23 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:24 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0" returned: 1 in 0.834s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_dadm4nu0' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c377a-cf91-42de-b422-e03df5c13bdd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:24 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD Jul 08 18:57:24 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-f67930e8-2c2d-45c6-930d-8f66f6effcd6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "cinder-f67930e8-2c2d-45c6-930d-8f66f6effcd6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Acquiring lock "cinder-quobyte-f67930e8-2c2d-45c6-930d-8f66f6effcd6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-f67930e8-2c2d-45c6-930d-8f66f6effcd6" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56dade4-f872-4d92-a15a-c529428911bb]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:24 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:24 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:24 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.865s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:57:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-140f43ea-5f86-48cf-87cd-0eb774783f32 tempest-VolumesGetTest-1523976626 None] Lock "cinder-b269f3ac-2ae0-4227-ac72-73469f9d118a-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:25 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:25 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] dd434acf-5aa9-44c3-8328-d41e2c476c9a was qcow2, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:57:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:25 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:25 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:25 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 0 in 0.907s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:25 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:25 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:26 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 1 in 0.877s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:26 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6 Jul 08 18:57:26 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:27 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f67930e8-2c2d-45c6-930d-8f66f6effcd6" returned: 0 in 0.685s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "cinder-quobyte-f67930e8-2c2d-45c6-930d-8f66f6effcd6" released by "delete_volume" :: held 2.557s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:27 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 2.133s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nlkjv6bhdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:57:27 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Converted 112.00 MB image at 52.48 MB/s Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Created reservations ['e4508736-00c9-4f14-94d3-34308ef3bb5c', '78596089-7b87-4b5b-93b8-258ba6bf7bb6', 'dd13def6-c66a-4536-bc93-71025788ca6b', '97eac731-528e-44d1-afb3-6447c6a9a7ad'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:27 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1G Jul 08 18:57:27 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:27 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:27 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:27 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 1G" returned: 0 in 0.732s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae51332-0130-476d-bf5e-4bde61566f27]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:28 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:28 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:28 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.742s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:28 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Deleted volume successfully. Jul 08 18:57:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8cda6f8f-5d8b-42f3-8e79-c4ab58c1646b tempest-VolumesGetTest-1523976626 None] Lock "cinder-f67930e8-2c2d-45c6-930d-8f66f6effcd6-delete_volume" released by "delete_volume" :: held 4.090s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:28 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 0.823s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:28 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:28 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:29 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 1 in 0.776s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Downloaded image dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume d2de5b47-ec30-4df6-a417-721638be8785 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a for user c54cd5d0d4be41fba7b7550ceea4eee9 is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Marking volume d2de5b47-ec30-4df6-a417-721638be8785 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Copying metadata from image dd434acf-5aa9-44c3-8328-d41e2c476c9a to d2de5b47-ec30-4df6-a417-721638be8785. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:57:29 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Creating volume glance metadata for volume d2de5b47-ec30-4df6-a417-721638be8785 backed by image dd434acf-5aa9-44c3-8328-d41e2c476c9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:57:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccad93db-4c42-4f37-bc53-b0f429bf1075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2de5b47-ec30-4df6-a417-721638be8785', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45f6217-df4a-4d12-84e5-f65ddd9b360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:30 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Volume volume-d2de5b47-ec30-4df6-a417-721638be8785 (d2de5b47-ec30-4df6-a417-721638be8785): created successfully Jul 08 18:57:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45f6217-df4a-4d12-84e5-f65ddd9b360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:30 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Flow 'volume_create_manager' (8e261ecf-423e-42bc-8359-df68b5b19a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:30 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-41f20631-344c-403e-9643-ab8e4ed9ba03 tempest-VolumesExtendTest-688584292 None] Created volume successfully. Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (3016eb66-cfd5-4870-8fa3-78a2c58fb68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5358710b-e9b1-4675-909a-7fc07540a66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5358710b-e9b1-4675-909a-7fc07540a66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579725685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a21072-213b-4563-ba8f-1f4c4035c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:31Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6031d0-20ed-4b94-8c47-ab9a849e8fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6031d0-20ed-4b94-8c47-ab9a849e8fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45188f-2d88-4441-9aae-63e0c2785266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d45188f-2d88-4441-9aae-63e0c2785266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a21072-213b-4563-ba8f-1f4c4035c8c5', 'volume_name': 'volume-26a21072-213b-4563-ba8f-1f4c4035c8c5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c1b56-d8d7-4807-97aa-fe86b91640a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56c1b56-d8d7-4807-97aa-fe86b91640a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a68726-8f3c-4a70-b5e4-2ec4b144b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:31 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume 26a21072-213b-4563-ba8f-1f4c4035c8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a21072-213b-4563-ba8f-1f4c4035c8c5', 'volume_size': 1} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1579725685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a21072-213b-4563-ba8f-1f4c4035c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:31Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume 26a21072-213b-4563-ba8f-1f4c4035c8c5 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:31 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:31 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 1073741824 Jul 08 18:57:31 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:32 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 1073741824" returned: 0 in 0.937s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:32 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=93,cinder:UPDATE=115,cinder:INSERT=43,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:57:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:32 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 Jul 08 18:57:32 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:33 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.228s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a68726-8f3c-4a70-b5e4-2ec4b144b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a21072-213b-4563-ba8f-1f4c4035c8c5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0e588d-4b37-4af9-b03b-2bee5679c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba355f-9180-4e17-b281-bd91cfffa859]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 (26a21072-213b-4563-ba8f-1f4c4035c8c5): created successfully Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0e588d-4b37-4af9-b03b-2bee5679c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (3016eb66-cfd5-4870-8fa3-78a2c58fb68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Flow 'volume_create_manager' (0c15b1b4-e61f-4115-9860-81ff65fce0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bd7488-3654-46c0-95af-842dd3b5eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a633720b-bcb6-4f3a-80a0-160672403521 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bd7488-3654-46c0-95af-842dd3b5eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1172757090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fc888e-6357-491b-844b-24f9bec48900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d987b745b374fd1b42e16e18952fb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:33Z,use_quota=True,user_id='ccf6eec57ad142a9b8cb11fa2eeb87c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5233281-50bd-42a8-a72f-3219585b26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5233281-50bd-42a8-a72f-3219585b26f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:33 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2ccd1d-754b-4b0d-ba47-0bb2c5c8b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2ccd1d-754b-4b0d-ba47-0bb2c5c8b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fc888e-6357-491b-844b-24f9bec48900', 'volume_name': 'volume-65fc888e-6357-491b-844b-24f9bec48900', 'volume_size': 2}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41e7c86-b1ea-4ed6-857a-5005e7c5ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41e7c86-b1ea-4ed6-857a-5005e7c5ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e797a6-2092-4d8f-a31a-2bd7eb3e0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Volume 65fc888e-6357-491b-844b-24f9bec48900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fc888e-6357-491b-844b-24f9bec48900', 'volume_size': 2} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:33 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:33 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:33 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (51f3a939-b460-48ba-910b-d2ee02321e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d054a8-ffc8-4ee8-852b-418e46deec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d054a8-ffc8-4ee8-852b-418e46deec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035803100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69130d50-c496-490b-9ca0-a4895a78156d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78fa99a-1403-4b95-880e-8b3aa7e145e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78fa99a-1403-4b95-880e-8b3aa7e145e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abe2344-771b-4d09-a4c5-eeaa6db9174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abe2344-771b-4d09-a4c5-eeaa6db9174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69130d50-c496-490b-9ca0-a4895a78156d', 'volume_name': 'volume-69130d50-c496-490b-9ca0-a4895a78156d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df1b72f-e639-4215-b4d2-fd71fbaf2992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df1b72f-e639-4215-b4d2-fd71fbaf2992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7328a4d2-4cf6-4480-a0cf-18dfa3af00ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume 69130d50-c496-490b-9ca0-a4895a78156d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69130d50-c496-490b-9ca0-a4895a78156d', 'volume_size': 1} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 1 in 0.857s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 2G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 2G" returned: 0 in 0.086s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.823s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1172757090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fc888e-6357-491b-844b-24f9bec48900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d987b745b374fd1b42e16e18952fb8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:33Z,use_quota=True,user_id='ccf6eec57ad142a9b8cb11fa2eeb87c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Creating volume 65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:34 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 2147483648 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:34 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 2147483648 Jul 08 18:57:34 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ae781a9d-f3b2-4bb5-ad6f-579bb0220399 tempest-VolumesExtendTest-688584292 None] Extend volume completed successfully. Jul 08 18:57:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (a77beda8-2630-4b60-b676-7a785bbbb970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9defead-3dff-40ec-8441-d91af9148100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9defead-3dff-40ec-8441-d91af9148100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2088486335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304147e3-4e3e-4099-aae7-495f465bec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6d218f-c506-4fc4-9034-518861edf632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6d218f-c506-4fc4-9034-518861edf632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725128c4-03b7-4613-91b6-9323c2ed51f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725128c4-03b7-4613-91b6-9323c2ed51f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304147e3-4e3e-4099-aae7-495f465bec60', 'volume_name': 'volume-304147e3-4e3e-4099-aae7-495f465bec60', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc1981d-761f-49e3-837b-8f2405c375de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc1981d-761f-49e3-837b-8f2405c375de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5541c2-7899-4f92-87b0-f1a7fe836404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume 304147e3-4e3e-4099-aae7-495f465bec60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304147e3-4e3e-4099-aae7-495f465bec60', 'volume_size': 1} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-d2de5b47-ec30-4df6-a417-721638be8785-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "cinder-d2de5b47-ec30-4df6-a417-721638be8785-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-quobyte-d2de5b47-ec30-4df6-a417-721638be8785" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-d2de5b47-ec30-4df6-a417-721638be8785" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (64fb1132-c873-40b4-89ab-6ecb0afc81c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77a3819-8ae9-47bf-ad6e-89ac8ae0e13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab587c3c-e02b-4906-adc0-24445c635c4d]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77a3819-8ae9-47bf-ad6e-89ac8ae0e13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750091852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8428aa-b40d-4e24-be36-99d2cddce3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373dd064-d21a-4731-935e-897aa549f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373dd064-d21a-4731-935e-897aa549f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc93453-18e1-4de7-9fbf-13f429f88a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc93453-18e1-4de7-9fbf-13f429f88a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8428aa-b40d-4e24-be36-99d2cddce3d7', 'volume_name': 'volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e48570-43b3-4752-8afa-3ac839c16aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e48570-43b3-4752-8afa-3ac839c16aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feb00b0-57a4-4ac9-872e-4d8f829b8eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume 6f8428aa-b40d-4e24-be36-99d2cddce3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7', 'volume_size': 1} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:35 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:35 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:35 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (b3c4cd31-8781-4a84-8b3a-4c896311399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ae3a23-1587-4008-86c6-53a335c79848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 2147483648" returned: 0 in 1.103s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ae3a23-1587-4008-86c6-53a335c79848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946015117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f86754-dc7d-411c-b56f-6bb742a55944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:36Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762df0c-2eeb-4ec7-b3d3-42a91f61dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762df0c-2eeb-4ec7-b3d3-42a91f61dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ec5ae4-0ec7-4fda-affc-491e90c6f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ec5ae4-0ec7-4fda-affc-491e90c6f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f86754-dc7d-411c-b56f-6bb742a55944', 'volume_name': 'volume-67f86754-dc7d-411c-b56f-6bb742a55944', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1941399c-3dca-41f9-8807-b323da6d4522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1941399c-3dca-41f9-8807-b323da6d4522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd487c2c-d42a-4201-b248-22a62ff7fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume 67f86754-dc7d-411c-b56f-6bb742a55944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f86754-dc7d-411c-b56f-6bb742a55944', 'volume_size': 1} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 Jul 08 18:57:36 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (2eff7dfb-58fa-4cf5-901d-874f35b6708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb32d2e5-9042-47be-b9f2-70c42d90080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 0.936s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb32d2e5-9042-47be-b9f2-70c42d90080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353117120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f9975e-f525-4ae8-bf9d-082fecd00be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:36Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d4833e-aec1-4676-a264-0ee64cbb2595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d4833e-aec1-4676-a264-0ee64cbb2595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f7a70-2705-40f8-97d9-e323cf851343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f7a70-2705-40f8-97d9-e323cf851343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f9975e-f525-4ae8-bf9d-082fecd00be6', 'volume_name': 'volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23680b1a-dd46-4afd-9f9c-3a67ce2f6ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23680b1a-dd46-4afd-9f9c-3a67ce2f6ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71faa734-c356-41e6-abc2-114ceed8f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume a8f9975e-f525-4ae8-bf9d-082fecd00be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6', 'volume_size': 1} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:36 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:36 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900" returned: 0 in 0.742s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035803100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69130d50-c496-490b-9ca0-a4895a78156d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume 69130d50-c496-490b-9ca0-a4895a78156d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:36 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e797a6-2092-4d8f-a31a-2bd7eb3e0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fc888e-6357-491b-844b-24f9bec48900', 'volume_size': 2}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d 1073741824 Jul 08 18:57:36 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2fa3b-3c1e-4137-8fde-586817ddb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Volume volume-65fc888e-6357-491b-844b-24f9bec48900 (65fc888e-6357-491b-844b-24f9bec48900): created successfully Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2fa3b-3c1e-4137-8fde-586817ddb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Flow 'volume_create_manager' (0c15b1b4-e61f-4115-9860-81ff65fce0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-cda1c955-1ef5-4c54-9914-736955f49d28 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Created volume successfully. Jul 08 18:57:37 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 1 in 0.789s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:37 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785 Jul 08 18:57:37 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:37 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d 1073741824" returned: 0 in 0.914s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:37 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d Jul 08 18:57:37 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:38 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d2de5b47-ec30-4df6-a417-721638be8785" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-d2de5b47-ec30-4df6-a417-721638be8785" released by "delete_volume" :: held 2.623s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Created reservations ['2673ab34-407c-45c8-8d7b-1e4f36948a57', 'c016eb66-0ac2-46ef-b89c-881e56346895', '96c81a2c-2f32-43bd-aa54-f7ef37f9e5c2', '0a744967-776d-4129-848f-b688e9282a99'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:38 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:38 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:38 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.342s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2088486335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304147e3-4e3e-4099-aae7-495f465bec60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume 304147e3-4e3e-4099-aae7-495f465bec60 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:38 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:38 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 1073741824 Jul 08 18:57:38 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7328a4d2-4cf6-4480-a0cf-18dfa3af00ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69130d50-c496-490b-9ca0-a4895a78156d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da6282f-860f-4562-ba9f-0bafebf0f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-69130d50-c496-490b-9ca0-a4895a78156d (69130d50-c496-490b-9ca0-a4895a78156d): created successfully Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da6282f-860f-4562-ba9f-0bafebf0f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (51f3a939-b460-48ba-910b-d2ee02321e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a121b629-89ca-4890-ad75-1dc624bdd3c1 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:38 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Deleted volume successfully. Jul 08 18:57:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-94fe01ba-013c-41d8-88e7-f1796d8b5876 tempest-VolumesExtendTest-688584292 None] Lock "cinder-d2de5b47-ec30-4df6-a417-721638be8785-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Flow 'volume_create_manager' (00093e26-fc5c-423e-acd2-97c1b70119b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acac384a-0c5c-4771-95e5-83bcfb7b197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acac384a-0c5c-4771-95e5-83bcfb7b197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-973060278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3973e7-dfd8-44e8-a123-3d61383b6600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f2e6fb79e4ab9b369d5b404e8ea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:39Z,use_quota=True,user_id='c54cd5d0d4be41fba7b7550ceea4eee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee19e1e-92ef-44a7-8972-248dce740cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee19e1e-92ef-44a7-8972-248dce740cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ac3e1f-ff58-4aba-b45e-d0e065ec407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ac3e1f-ff58-4aba-b45e-d0e065ec407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3973e7-dfd8-44e8-a123-3d61383b6600', 'volume_name': 'volume-7e3973e7-dfd8-44e8-a123-3d61383b6600', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491ae600-0ab0-4622-bc54-0df62bc13778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491ae600-0ab0-4622-bc54-0df62bc13778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a161d9-825a-489e-a4dd-b88057802e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:39 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Volume 7e3973e7-dfd8-44e8-a123-3d61383b6600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3973e7-dfd8-44e8-a123-3d61383b6600', 'volume_size': 1} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:39 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 1073741824" returned: 0 in 0.893s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:39 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 Jul 08 18:57:39 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:40 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750091852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8428aa-b40d-4e24-be36-99d2cddce3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:35Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume 6f8428aa-b40d-4e24-be36-99d2cddce3d7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:40 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:40 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 1073741824 Jul 08 18:57:40 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5541c2-7899-4f92-87b0-f1a7fe836404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304147e3-4e3e-4099-aae7-495f465bec60', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35b3ac8-39a4-4aaa-8287-bc9188b0a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:40 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-304147e3-4e3e-4099-aae7-495f465bec60 (304147e3-4e3e-4099-aae7-495f465bec60): created successfully Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35b3ac8-39a4-4aaa-8287-bc9188b0a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (a77beda8-2630-4b60-b676-7a785bbbb970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-036d5fa6-ae4b-4e5c-9e3e-be0add488483 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:40 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 1073741824" returned: 0 in 0.907s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:41 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 Jul 08 18:57:41 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:41 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.651s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946015117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f86754-dc7d-411c-b56f-6bb742a55944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:36Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume 67f86754-dc7d-411c-b56f-6bb742a55944 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:41 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:41 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 1073741824 Jul 08 18:57:41 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feb00b0-57a4-4ac9-872e-4d8f829b8eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0877fa9-1daa-4c63-8d79-5ed8a019c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 (6f8428aa-b40d-4e24-be36-99d2cddce3d7): created successfully Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0877fa9-1daa-4c63-8d79-5ed8a019c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (64fb1132-c873-40b4-89ab-6ecb0afc81c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0172e21b-62d2-4b8a-b9dc-76186b3fae54 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:42 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 1073741824" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:42 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 Jul 08 18:57:42 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:43 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944" returned: 0 in 0.661s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.693s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353117120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f9975e-f525-4ae8-bf9d-082fecd00be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82496e3ea34046f3ba2070361e0599b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:36Z,use_quota=True,user_id='bddc9ecee46c4ba4ba08e6dd3dac3233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Creating volume a8f9975e-f525-4ae8-bf9d-082fecd00be6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd487c2c-d42a-4201-b248-22a62ff7fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f86754-dc7d-411c-b56f-6bb742a55944', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:43 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 1073741824 Jul 08 18:57:43 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe9dbd-774f-47bc-9c19-b2cb786baed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-67f86754-dc7d-411c-b56f-6bb742a55944 (67f86754-dc7d-411c-b56f-6bb742a55944): created successfully Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe9dbd-774f-47bc-9c19-b2cb786baed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (b3c4cd31-8781-4a84-8b3a-4c896311399e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3c69f2db-6550-44a6-be4f-8079200df864 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:44 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 1073741824" returned: 0 in 0.834s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:44 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 Jul 08 18:57:44 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:44 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6" returned: 0 in 0.668s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.293s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71faa734-c356-41e6-abc2-114ceed8f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03078a13-9647-45b9-99e6-9923dd87d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Creating offline snapshot a5210c05-151d-4180-ae9c-188b4be2ef3d of volume 65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:57:44 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Volume volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 (a8f9975e-f525-4ae8-bf9d-082fecd00be6): created successfully Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03078a13-9647-45b9-99e6-9923dd87d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Flow 'volume_create_manager' (2eff7dfb-58fa-4cf5-901d-874f35b6708b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[890fd022-cedd-46da-9761-838d6d3ec48f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-09910946-294c-45fd-9850-ddc328310fab tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created volume successfully. Jul 08 18:57:44 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 Jul 08 18:57:44 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-a8f9975e-f525-4ae8-bf9d-082fecd00be6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-a8f9975e-f525-4ae8-bf9d-082fecd00be6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-a8f9975e-f525-4ae8-bf9d-082fecd00be6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-a8f9975e-f525-4ae8-bf9d-082fecd00be6" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ebfbd-201e-45bd-b1bd-5811480f03d9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:45 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 Jul 08 18:57:45 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:45 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d 2G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:45 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d 2G Jul 08 18:57:45 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:46 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:46 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6 Jul 08 18:57:46 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:46 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d 2G" returned: 0 in 0.825s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fc888e-6357-491b-844b-24f9bec48900 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:46 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fc888e-6357-491b-844b-24f9bec48900 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d Jul 08 18:57:46 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:46 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a8f9975e-f525-4ae8-bf9d-082fecd00be6" returned: 0 in 0.678s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-a8f9975e-f525-4ae8-bf9d-082fecd00be6" released by "delete_volume" :: held 1.570s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=126,cinder:SELECT=111,cinder:INSERT=47,cinder:DELETE=14 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['9bc288ac-7145-4a28-b7fc-9d91af3c4029', '5c1821d9-d3e6-40d7-bdfe-d497292a996f', 'a876216f-9314-476b-9a05-179bc58c83d8', '6b16ceac-ddaf-4e96-810f-dd03b7edc47d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:46 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:46 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fc888e-6357-491b-844b-24f9bec48900 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d" returned: 0 in 0.690s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d is being set with open permissions: ugo+rw Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d Jul 08 18:57:47 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-67f86754-dc7d-411c-b56f-6bb742a55944-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-67f86754-dc7d-411c-b56f-6bb742a55944-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-67f86754-dc7d-411c-b56f-6bb742a55944" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-67f86754-dc7d-411c-b56f-6bb742a55944" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a32bcbd-b6e5-4e25-a022-c9aed1ce4824]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.726s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:47 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 Jul 08 18:57:47 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-edb00875-3ce2-497c-90c1-bf3394654f49 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-a8f9975e-f525-4ae8-bf9d-082fecd00be6-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:47 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d" returned: 0 in 0.748s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:47 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info Jul 08 18:57:47 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944" returned: 0 in 0.819s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944 Jul 08 18:57:48 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:48 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info" returned: 0 in 0.680s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:48 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info is being set with open permissions: ugo+rw Jul 08 18:57:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:48 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info Jul 08 18:57:48 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-67f86754-dc7d-411c-b56f-6bb742a55944" returned: 0 in 0.708s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-67f86754-dc7d-411c-b56f-6bb742a55944" released by "delete_volume" :: held 1.572s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['179a201a-725e-44a3-9b5e-b3eac3523568', '588391ce-bc39-4baa-b7ad-c4abd42b4997', '2e86606e-d44a-44db-8c85-359d2e117cba', '29b9ff19-b817-4c25-853b-8d0d7a053379'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:49 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.info" returned: 0 in 0.659s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.065s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-973060278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3973e7-dfd8-44e8-a123-3d61383b6600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71f2e6fb79e4ab9b369d5b404e8ea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:57:39Z,use_quota=True,user_id='c54cd5d0d4be41fba7b7550ceea4eee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Creating volume 7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:57:49 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 1073741824 Jul 08 18:57:49 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6ba149ef-48c9-4c09-a27c-d484f0066a7e tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Create snapshot completed successfully Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-6f8428aa-b40d-4e24-be36-99d2cddce3d7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-6f8428aa-b40d-4e24-be36-99d2cddce3d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-6f8428aa-b40d-4e24-be36-99d2cddce3d7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-6f8428aa-b40d-4e24-be36-99d2cddce3d7" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008d5d4-a847-4de9-824f-87795a1200f6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:49 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.698s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:49 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 Jul 08 18:57:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bb6fb7cf-8d8d-4dcc-a17f-0512b5462e68 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-67f86754-dc7d-411c-b56f-6bb742a55944-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:49 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "cinder-a5210c05-151d-4180-ae9c-188b4be2ef3d-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-a5210c05-151d-4180-ae9c-188b4be2ef3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "cinder-quobyte-a5210c05-151d-4180-ae9c-188b4be2ef3d" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-a5210c05-151d-4180-ae9c-188b4be2ef3d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Deleting offline snapshot a5210c05-151d-4180-ae9c-188b4be2ef3d of volume 65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] snapshot_file for this snap is: volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ae586-3d14-4677-ac63-950be6f43e5f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 1073741824" returned: 0 in 0.942s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:57:50 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d Jul 08 18:57:50 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7" returned: 0 in 0.853s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:50 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7 Jul 08 18:57:50 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:50 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.701s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a161d9-825a-489e-a4dd-b88057802e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3973e7-dfd8-44e8-a123-3d61383b6600', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4962c21-a66f-48e1-8443-84bb9b5bfbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:57:50 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Volume volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 (7e3973e7-dfd8-44e8-a123-3d61383b6600): created successfully Jul 08 18:57:50 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4962c21-a66f-48e1-8443-84bb9b5bfbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:57:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Flow 'volume_create_manager' (00093e26-fc5c-423e-acd2-97c1b70119b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fc888e-6357-491b-844b-24f9bec48900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:57:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0cd3e1c8-439a-4614-a937-dbf16f4c0416 tempest-VolumesExtendTest-688584292 None] Created volume successfully. Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d7b22-2275-4d5e-ac26-770d7f0ae0c8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 Jul 08 18:57:51 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f8428aa-b40d-4e24-be36-99d2cddce3d7" returned: 0 in 0.711s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-6f8428aa-b40d-4e24-be36-99d2cddce3d7" released by "delete_volume" :: held 1.614s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['8844c57a-c2f1-451c-ad5e-e591e06058b7', '4c9d4734-f3f8-4e49-9e46-5ec0dcacad88', '458574b9-d349-4062-904d-4bce3cd9a177', '2095f69c-167a-4042-aa8f-83290b48f904'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:51 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900" returned: 0 in 0.774s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:51 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d Jul 08 18:57:51 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-304147e3-4e3e-4099-aae7-495f465bec60-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-304147e3-4e3e-4099-aae7-495f465bec60-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-304147e3-4e3e-4099-aae7-495f465bec60" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-304147e3-4e3e-4099-aae7-495f465bec60" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Creating offline snapshot d5d86213-e078-41e6-9857-e292703f6dcf of volume 7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0af832-a017-460f-b39c-e06d5a1e2746]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88982532-a65f-44f7-900d-6051077a76ea]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 Jul 08 18:57:52 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:57:52 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2e3e9b91-50e3-4cb3-88a8-0e8d3d37c83f tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-6f8428aa-b40d-4e24-be36-99d2cddce3d7-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:52 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d" returned: 0 in 0.875s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d Jul 08 18:57:52 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:52 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60" returned: 0 in 0.844s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:52 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.852s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:53 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60 Jul 08 18:57:53 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:53 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf 1G Jul 08 18:57:53 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:53 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900.a5210c05-151d-4180-ae9c-188b4be2ef3d" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-a5210c05-151d-4180-ae9c-188b4be2ef3d" released by "_delete_snapshot" :: held 3.278s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" released by "delete_snapshot" :: held 3.311s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Created reservations ['de1f6305-9bab-4a4a-be0c-df97f8f9d681', '217cd361-a0f9-42a1-a6c0-bec9fbfb22cb', '16bf122a-0325-43c5-ad6c-238244621a25', 'ec839cc9-447a-48d7-abf7-31a13de8f998'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Delete snapshot completed successfully. Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ea5eb05c-e9b5-4fa4-af7e-89b2003d81fe tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-a5210c05-151d-4180-ae9c-188b4be2ef3d-delete_snapshot" released by "delete_snapshot" :: held 3.459s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-304147e3-4e3e-4099-aae7-495f465bec60" returned: 0 in 0.711s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-304147e3-4e3e-4099-aae7-495f465bec60" released by "delete_volume" :: held 1.597s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['fdb918a0-7f17-407f-a41c-da6fcbe7c7cc', '9f66c0c0-49be-4f08-af68-33f0e9dc76bb', 'd436cfa7-75b4-403c-98c3-95ce9e87c3ab', 'cddcf09b-f7a1-43c6-8502-981822c269a9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:53 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:53 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:53 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf 1G" returned: 0 in 0.882s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:53 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf Jul 08 18:57:53 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-69130d50-c496-490b-9ca0-a4895a78156d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-69130d50-c496-490b-9ca0-a4895a78156d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-69130d50-c496-490b-9ca0-a4895a78156d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-69130d50-c496-490b-9ca0-a4895a78156d" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "cinder-65fc888e-6357-491b-844b-24f9bec48900-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f07efd-d8d4-46dd-a979-cd2454d8a3c0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-65fc888e-6357-491b-844b-24f9bec48900-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc816c-d9c4-485e-a5d7-0dcb3ae6870c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:54 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d Jul 08 18:57:54 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:54 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.836s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6576b34a-2a2d-4e27-89c8-b8e83986d1e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-304147e3-4e3e-4099-aae7-495f465bec60-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:54 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf" returned: 0 in 0.848s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:54 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf is being set with open permissions: ugo+rw Jul 08 18:57:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:54 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 Jul 08 18:57:54 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:54 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf Jul 08 18:57:54 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d" returned: 0 in 0.856s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d Jul 08 18:57:55 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf" returned: 0 in 0.710s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900" returned: 0 in 0.891s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:55 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info Jul 08 18:57:55 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:55 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900 Jul 08 18:57:55 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-69130d50-c496-490b-9ca0-a4895a78156d" returned: 0 in 0.728s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-69130d50-c496-490b-9ca0-a4895a78156d" released by "delete_volume" :: held 1.658s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['da2a3abf-f138-4b02-b6e4-5abe62e00d5f', '65099e16-2c58-4b41-8f5a-239363e55f72', '136aabc2-02fa-482a-acd5-7e419ad429c1', '0659bcf2-5ff4-4f4b-9394-027cee379a1c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:56 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info is being set with open permissions: ugo+rw Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:56 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info Jul 08 18:57:56 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65fc888e-6357-491b-844b-24f9bec48900" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:56 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:56 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-quobyte-65fc888e-6357-491b-844b-24f9bec48900" released by "delete_volume" :: held 1.730s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Created reservations ['6e76c42e-7fe8-4c60-8bcc-8b4e3d188f7f', '27a2cda8-012b-4344-946f-47f7a4888c3a', '22a4733a-4691-446c-8e53-3e5a4858f09d', 'db956014-c30b-4143-ab87-72e6fd891394'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:56 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-26a21072-213b-4563-ba8f-1f4c4035c8c5-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-26a21072-213b-4563-ba8f-1f4c4035c8c5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "cinder-quobyte-26a21072-213b-4563-ba8f-1f4c4035c8c5" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-26a21072-213b-4563-ba8f-1f4c4035c8c5" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13fc978-6d48-4720-81f7-e8237aa9e0c6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:56 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 Jul 08 18:57:56 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:57 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.027s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:57 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.info" returned: 0 in 1.134s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.238s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-5e15ae45-245e-4616-9490-5c2709cf37e3 tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-69130d50-c496-490b-9ca0-a4895a78156d-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-51c551e4-e397-4d14-ad1f-e500e645d6f9 tempest-VolumesExtendTest-688584292 None] Create snapshot completed successfully Jul 08 18:57:57 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.924s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Deleted volume successfully. Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2fd9cb2c-2d7b-4163-8225-9dd9a15697a3 tempest-VolumesSnapshotNegativeTestJSON-817315276 None] Lock "cinder-65fc888e-6357-491b-844b-24f9bec48900-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:57 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5" returned: 0 in 1.034s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:57 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5 Jul 08 18:57:57 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:58 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-26a21072-213b-4563-ba8f-1f4c4035c8c5" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-quobyte-26a21072-213b-4563-ba8f-1f4c4035c8c5" released by "delete_volume" :: held 1.837s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7a86a-c5a9-49b1-8639-0fc7c9569353]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Created reservations ['da14fa45-d595-49d4-9a2b-b3ddd1454d5c', 'b65dc132-e261-4f3f-a2ef-c9dc5ff651eb', '55a5de03-16c5-4435-9f4b-970d88fd6f90', '6a830865-2322-4b82-a9b5-cdf37daf4577'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:57:58 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:57:58 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:58 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:57:58 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:57:59 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.960s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf 2G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.825s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:57:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Deleted volume successfully. Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-619e81a8-68e1-4a6b-b599-d210c9e813db tempest-CreateVolumesFromSourceVolumeTest-634722951 None] Lock "cinder-26a21072-213b-4563-ba8f-1f4c4035c8c5-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf 2G" returned: 0 in 0.193s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:57:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.196s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:57:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ca7f6b3c-a4cf-4e48-ae58-aecc7523cb8b tempest-VolumesExtendTest-688584292 None] Extend volume completed successfully. Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Flow 'volume_create_manager' (ab434d68-85e7-4214-b76d-eb4325992950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f9e0c-1bb4-4462-befd-034e7cc91f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5f9e0c-1bb4-4462-befd-034e7cc91f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a7540f-6d88-4ed6-bf9c-c677051deffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de198390c2f4f149e2b3eebe44b6472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:00Z,use_quota=True,user_id='8ef5416898df4e32b6d78b7ca23e60d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98d7eb-e269-4dfd-ae1c-1369d4f09750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98d7eb-e269-4dfd-ae1c-1369d4f09750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6308d11a-a4ad-4e4e-8f27-7ff092f5bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6308d11a-a4ad-4e4e-8f27-7ff092f5bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a7540f-6d88-4ed6-bf9c-c677051deffd', 'volume_name': 'volume-71a7540f-6d88-4ed6-bf9c-c677051deffd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1accd754-3d9c-47e2-b5d2-1868034dbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1accd754-3d9c-47e2-b5d2-1868034dbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f30fe7-9f4e-40f8-84d2-ebd2238eba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:00 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Volume 71a7540f-6d88-4ed6-bf9c-c677051deffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a7540f-6d88-4ed6-bf9c-c677051deffd', 'volume_size': 1} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a7540f-6d88-4ed6-bf9c-c677051deffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de198390c2f4f149e2b3eebe44b6472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:00Z,use_quota=True,user_id='8ef5416898df4e32b6d78b7ca23e60d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Creating volume 71a7540f-6d88-4ed6-bf9c-c677051deffd {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:00 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:00 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd 1073741824 Jul 08 18:58:00 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-d5d86213-e078-41e6-9857-e292703f6dcf-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-d5d86213-e078-41e6-9857-e292703f6dcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-quobyte-d5d86213-e078-41e6-9857-e292703f6dcf" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-d5d86213-e078-41e6-9857-e292703f6dcf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Deleting offline snapshot d5d86213-e078-41e6-9857-e292703f6dcf of volume 7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] snapshot_file for this snap is: volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b2c70-5ce7-44d0-85b4-2e60f3b985ee]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:01 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf Jul 08 18:58:01 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:01 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd 1073741824" returned: 0 in 0.958s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:01 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd Jul 08 18:58:01 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:01 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf" returned: 0 in 0.808s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3973e7-dfd8-44e8-a123-3d61383b6600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[06185dc9-da4e-4773-b159-6b9899c85462]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:01 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:58:01 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:02 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f30fe7-9f4e-40f8-84d2-ebd2238eba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a7540f-6d88-4ed6-bf9c-c677051deffd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e3d2d1-3e5a-4683-a545-d7135a3f70b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:02 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Volume volume-71a7540f-6d88-4ed6-bf9c-c677051deffd (71a7540f-6d88-4ed6-bf9c-c677051deffd): created successfully Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e3d2d1-3e5a-4683-a545-d7135a3f70b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Flow 'volume_create_manager' (ab434d68-85e7-4214-b76d-eb4325992950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:02 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-22f313ae-15e1-4597-a5b5-41b712d3094a tempest-CinderUnicodeTest-1075589464 None] Created volume successfully. Jul 08 18:58:02 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.886s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:02 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf Jul 08 18:58:02 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Flow 'volume_create_manager' (58b68bc5-5535-4916-a89d-3826efa3f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4760cdfa-7cd0-438f-b526-4cbc32209e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4760cdfa-7cd0-438f-b526-4cbc32209e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1963519169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15fe228-0ecb-491d-a5b3-b0c39380e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de198390c2f4f149e2b3eebe44b6472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='8ef5416898df4e32b6d78b7ca23e60d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82064672-dd69-4908-afb3-aa25a2beff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82064672-dd69-4908-afb3-aa25a2beff75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b158d7-88e9-4592-8c57-e0cea7f8cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b158d7-88e9-4592-8c57-e0cea7f8cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15fe228-0ecb-491d-a5b3-b0c39380e892', 'volume_name': 'volume-c15fe228-0ecb-491d-a5b3-b0c39380e892', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fe0e2c-b9bc-4eda-a4e5-9fd9c7d5aa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fe0e2c-b9bc-4eda-a4e5-9fd9c7d5aa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c596781a-8bff-45e9-b7dd-b088fddd7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Volume c15fe228-0ecb-491d-a5b3-b0c39380e892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15fe228-0ecb-491d-a5b3-b0c39380e892', 'volume_size': 1} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1963519169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15fe228-0ecb-491d-a5b3-b0c39380e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de198390c2f4f149e2b3eebe44b6472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:03Z,use_quota=True,user_id='8ef5416898df4e32b6d78b7ca23e60d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Creating volume c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:03 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:03 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 1073741824 Jul 08 18:58:03 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:03 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf" returned: 0 in 0.832s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:03 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf Jul 08 18:58:03 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:04 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 1073741824" returned: 0 in 0.983s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:04 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 Jul 08 18:58:04 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:04 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600.d5d86213-e078-41e6-9857-e292703f6dcf" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-d5d86213-e078-41e6-9857-e292703f6dcf" released by "_delete_snapshot" :: held 3.406s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" released by "delete_snapshot" :: held 3.435s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Created reservations ['f7aa15f8-80da-4ee5-9988-fdc8b2519737', '7342277c-df0e-4984-b120-6a051d611607', '3cfc5b10-7824-4528-b277-ab494b87c7ae', '0a5b51be-4385-4c17-b50a-2b063b98a0a6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Delete snapshot completed successfully. Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e1d73c3e-9f5d-4019-8d9a-1fb45d0a06ce tempest-VolumesExtendTest-688584292 None] Lock "cinder-d5d86213-e078-41e6-9857-e292703f6dcf-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Flow 'volume_create_manager' (0f79634e-3f51-4483-8e71-868326de721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7e3e4a-417a-4fea-b297-58e6e09f18d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7e3e4a-417a-4fea-b297-58e6e09f18d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafc7c8d-4cc2-415a-9401-8ced06ad1490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20105555142d4053b969b7968bb1c632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:05Z,use_quota=True,user_id='70f570c2511c4b18ad6854d5dfd849c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953e478f-e423-47fe-a250-ec409254128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953e478f-e423-47fe-a250-ec409254128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba405249-dfe6-4d6a-91a9-54e1d6adef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892" returned: 0 in 0.760s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c596781a-8bff-45e9-b7dd-b088fddd7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15fe228-0ecb-491d-a5b3-b0c39380e892', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf7fd48-58c3-4515-a942-cfe93d13777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Volume volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 (c15fe228-0ecb-491d-a5b3-b0c39380e892): created successfully Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf7fd48-58c3-4515-a942-cfe93d13777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Flow 'volume_create_manager' (58b68bc5-5535-4916-a89d-3826efa3f249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e424260e-920b-4dd6-a4d2-2230850a9fbb tempest-CinderUnicodeTest-1075589464 None] Created volume successfully. Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba405249-dfe6-4d6a-91a9-54e1d6adef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eafc7c8d-4cc2-415a-9401-8ced06ad1490', 'volume_name': 'volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490', 'volume_size': 1, 'image_id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5d4520409cc19e6cf48523acc94fbbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20105555142d4053b969b7968bb1c632', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '989d1c914040493759855fa8e0b8422fffbcd058f9c3867c3e0d9e084e9918c02cf7c3b0cb401d28404fedadd68fa01c783982a25e1d496421760b7b6ffa0c7b', 'id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'created_at': datetime.datetime(2026, 7, 8, 16, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1de7599-65b0-4292-b294-e22a75e9297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1de7599-65b0-4292-b294-e22a75e9297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6468aa-2eca-42d7-a29d-7c047e1fc5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Volume eafc7c8d-4cc2-415a-9401-8ced06ad1490: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490', 'volume_size': 1, 'image_id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5d4520409cc19e6cf48523acc94fbbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20105555142d4053b969b7968bb1c632', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '989d1c914040493759855fa8e0b8422fffbcd058f9c3867c3e0d9e084e9918c02cf7c3b0cb401d28404fedadd68fa01c783982a25e1d496421760b7b6ffa0c7b', 'id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'created_at': datetime.datetime(2026, 7, 8, 16, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3/file', 'properties': {}}, 'image_service': } Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Trying to clone eafc7c8d-4cc2-415a-9401-8ced06ad1490 from image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-7e3973e7-dfd8-44e8-a123-3d61383b6600-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "cinder-7e3973e7-dfd8-44e8-a123-3d61383b6600-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Acquiring lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:58:05 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed047b9-2e9d-4a67-a2a8-0e0f584f6d18]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd05ca00-fc69-44b2-8e63-27daaddbc89c]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Creating offline snapshot 37c93ea6-80b8-4d8d-87da-23f8495a4682 of volume c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d76d4-7d76-4bda-b383-c905cc7d0e57]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:05 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:58:05 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:05 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:05 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:05 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 Jul 08 18:58:05 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:06 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892" returned: 0 in 0.799s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.916s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:06 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 1G Jul 08 18:58:06 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600 Jul 08 18:58:06 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:06 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:06 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 1 in 0.790s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:06 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Temporary image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 is fetched for user 70f570c2511c4b18ad6854d5dfd849c3. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:58:07 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7e3973e7-dfd8-44e8-a123-3d61383b6600" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "cinder-quobyte-7e3973e7-dfd8-44e8-a123-3d61383b6600" released by "delete_volume" :: held 1.720s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daed7f2-ccbe-4aac-ad26-f87e61fa72be]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Created reservations ['d6eb69a2-e880-4925-9e4c-48a84d277ee4', '2843ac62-012f-4dc7-86b7-08d531f4cd99', 'da64d050-0241-4118-91f7-9666505495c3', 'b87fd143-0265-4b98-ac4c-204c2f6f3c49'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:07 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 1G" returned: 0 in 0.876s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 Jul 08 18:58:07 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:07 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:07 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:07 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:07 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.796s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:08 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:08 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:08 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Deleted volume successfully. Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682" returned: 0 in 0.874s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 is being set with open permissions: ugo+rw Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 Jul 08 18:58:08 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e06f6303-21a2-41b9-a4e4-6e3bcb544a80 tempest-VolumesExtendTest-688584292 None] Lock "cinder-7e3973e7-dfd8-44e8-a123-3d61383b6600-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:08 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 1 in 0.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:08 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682" returned: 0 in 0.724s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:08 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info Jul 08 18:58:08 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:09 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:09 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info is being set with open permissions: ugo+rw Jul 08 18:58:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:09 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info Jul 08 18:58:09 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:10 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.info" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafc7c8d-4cc2-415a-9401-8ced06ad1490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20105555142d4053b969b7968bb1c632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:05Z,use_quota=True,user_id='70f570c2511c4b18ad6854d5dfd849c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Creating volume eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:10 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:10 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1073741824 Jul 08 18:58:10 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b8a7c22e-77f8-49a8-b8fe-85bc2e7707b8 tempest-CinderUnicodeTest-1075589464 None] Create snapshot completed successfully Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (b892535b-4b0e-4673-8e07-d8db80484a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245f501f-2731-40da-8326-36941430664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245f501f-2731-40da-8326-36941430664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1791274588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96e99e8-0e01-48a3-bb79-d6e2a8478d65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:10Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac75f81-2e27-48d4-b982-5828ec8a08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac75f81-2e27-48d4-b982-5828ec8a08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce8139-76fd-4939-8ae1-4ac0a5e06631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfce8139-76fd-4939-8ae1-4ac0a5e06631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96e99e8-0e01-48a3-bb79-d6e2a8478d65', 'volume_name': 'volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c0e72f-a03b-436b-94bc-e9f6bf5528d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c0e72f-a03b-436b-94bc-e9f6bf5528d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c81e579-7893-414c-b144-344b8b517c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:10 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Volume f96e99e8-0e01-48a3-bb79-d6e2a8478d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65', 'volume_size': 1} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-37c93ea6-80b8-4d8d-87da-23f8495a4682-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-37c93ea6-80b8-4d8d-87da-23f8495a4682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-quobyte-37c93ea6-80b8-4d8d-87da-23f8495a4682" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-37c93ea6-80b8-4d8d-87da-23f8495a4682" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Deleting offline snapshot 37c93ea6-80b8-4d8d-87da-23f8495a4682 of volume c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] snapshot_file for this snap is: volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9915326-5d5d-4060-8e1d-5018b7a77b85]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:10 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 Jul 08 18:58:10 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1073741824" returned: 0 in 0.866s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:11 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:11 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682" returned: 0 in 0.783s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15fe228-0ecb-491d-a5b3-b0c39380e892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ed1857-b9e7-4480-9890-7ce341e7cdc4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:11 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 Jul 08 18:58:11 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1791274588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96e99e8-0e01-48a3-bb79-d6e2a8478d65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:10Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Creating volume f96e99e8-0e01-48a3-bb79-d6e2a8478d65 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:11 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:11 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 1073741824 Jul 08 18:58:11 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:11 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Attempting download of 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 ((None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}])) to volume eafc7c8d-4cc2-415a-9401-8ced06ad1490. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc146b3-3899-4495-b591-8b3fd7abbeb9]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770 Jul 08 18:58:12 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:12 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 Jul 08 18:58:12 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:12 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 1073741824" returned: 0 in 0.858s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:12 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:12 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 Jul 08 18:58:12 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:12 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770 Jul 08 18:58:12 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682" returned: 0 in 0.771s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:13 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682 Jul 08 18:58:13 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770" returned: 1 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_etkl_770' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:13 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00edb4a1-e168-4a74-bf51-517be7dc6784]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c81e579-7893-414c-b144-344b8b517c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696cf29-ffc9-46d6-98cf-2db23502833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Volume volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 (f96e99e8-0e01-48a3-bb79-d6e2a8478d65): created successfully Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696cf29-ffc9-46d6-98cf-2db23502833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (b892535b-4b0e-4673-8e07-d8db80484a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-861c977b-710a-445c-94cf-24882b9f70b1 tempest-VolumesListTestJSON-1208335622 None] Created volume successfully. Jul 08 18:58:13 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:13 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:13 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892.37c93ea6-80b8-4d8d-87da-23f8495a4682" returned: 0 in 0.684s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-37c93ea6-80b8-4d8d-87da-23f8495a4682" released by "_delete_snapshot" :: held 3.140s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" released by "delete_snapshot" :: held 3.163s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Created reservations ['07da43b7-4568-40a0-8e5c-5a4f845cff7e', 'd6cc6155-8c0a-4e85-864d-3a3e99ba408c', '38766218-0282-4252-8f50-4c3ccbfcb337', '78e397ef-f6dc-42e4-b773-813f1156f924'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Delete snapshot completed successfully. Jul 08 18:58:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1a46f9ad-dee5-46db-b047-ae5c63d5f657 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-37c93ea6-80b8-4d8d-87da-23f8495a4682-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:14 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:14 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD Jul 08 18:58:14 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-c15fe228-0ecb-491d-a5b3-b0c39380e892-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-c15fe228-0ecb-491d-a5b3-b0c39380e892-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:15 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD" returned: 1 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 was raw, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6277c0ad-2824-4985-97a6-a07527e60646]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:15 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (562dc4e3-93ea-4b59-910d-6ae780974e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:15 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 Jul 08 18:58:15 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fe589d-3b0b-49dc-945f-13ced455ab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fe589d-3b0b-49dc-945f-13ced455ab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155701860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce964f-1c79-4507-b35d-ccae2a251420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:15Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc78c658-4ab0-49cf-a16a-bf394a591fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc78c658-4ab0-49cf-a16a-bf394a591fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf64c70a-5cee-481b-b6c1-708ae4c3b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf64c70a-5cee-481b-b6c1-708ae4c3b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ce964f-1c79-4507-b35d-ccae2a251420', 'volume_name': 'volume-56ce964f-1c79-4507-b35d-ccae2a251420', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c65f1f-c805-4fe4-ad9c-8b23ea5c0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c65f1f-c805-4fe4-ad9c-8b23ea5c0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8972e42a-e954-4b92-8a10-6ec1dbd1b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Volume 56ce964f-1c79-4507-b35d-ccae2a251420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ce964f-1c79-4507-b35d-ccae2a251420', 'volume_size': 1} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155701860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ce964f-1c79-4507-b35d-ccae2a251420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:15Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Creating volume 56ce964f-1c79-4507-b35d-ccae2a251420 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:15 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 1073741824 Jul 08 18:58:15 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:15 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 0 in 0.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75ddc22d-e606-4e0e-803e-11f7c7d37ba3_x68muoi_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:58:15 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892" returned: 0 in 0.835s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:15 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1G Jul 08 18:58:15 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892 Jul 08 18:58:16 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 1073741824" returned: 0 in 0.956s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:16 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 Jul 08 18:58:16 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 1G" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e59bc8-5a2c-47a9-bccd-51b079f7ed52]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:16 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c15fe228-0ecb-491d-a5b3-b0c39380e892" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-c15fe228-0ecb-491d-a5b3-b0c39380e892" released by "delete_volume" :: held 1.678s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Created reservations ['1a8f9859-3eba-49c5-9104-29914d17e1e4', '717aa723-859b-4796-8096-ff6b6ae9dcc6', '65d1499e-cdce-499b-8786-7311e086f4f6', '77c3e845-eefc-42e8-abe8-415758846c3c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:16 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:16 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:16 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:16 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420" returned: 0 in 0.736s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8972e42a-e954-4b92-8a10-6ec1dbd1b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ce964f-1c79-4507-b35d-ccae2a251420', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ded1092-c401-4fbf-986d-cc9b5aec0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Volume volume-56ce964f-1c79-4507-b35d-ccae2a251420 (56ce964f-1c79-4507-b35d-ccae2a251420): created successfully Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ded1092-c401-4fbf-986d-cc9b5aec0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (562dc4e3-93ea-4b59-910d-6ae780974e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-757e9118-a22b-46bd-bc31-8e1b09d84049 tempest-VolumesListTestJSON-1208335622 None] Created volume successfully. Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-71a7540f-6d88-4ed6-bf9c-c677051deffd-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-71a7540f-6d88-4ed6-bf9c-c677051deffd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "cinder-quobyte-71a7540f-6d88-4ed6-bf9c-c677051deffd" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-71a7540f-6d88-4ed6-bf9c-c677051deffd" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96fe564-e580-4bcf-ba6f-77d1117a74c3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd Jul 08 18:58:17 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 0 in 0.986s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.834s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Deleted volume successfully. Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-74465155-a4fe-4ebd-845c-f76ef55f2179 tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-c15fe228-0ecb-491d-a5b3-b0c39380e892-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:17 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:17 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:17 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (1ff956bf-9bed-46a1-9d41-a260a3e1c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7710ba66-e6fc-490e-b02f-59ceaaf9ef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7710ba66-e6fc-490e-b02f-59ceaaf9ef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-433898383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7d1e47-098e-4336-a0f0-2a411b3534b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:18Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632d1f0-5cd4-40bf-928a-08d0b5cf2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632d1f0-5cd4-40bf-928a-08d0b5cf2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a91633-d98a-4ea1-8e2b-6acff31907c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a91633-d98a-4ea1-8e2b-6acff31907c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7d1e47-098e-4336-a0f0-2a411b3534b7', 'volume_name': 'volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fadc04-79bd-45b3-a6d6-0c40c99ab1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fadc04-79bd-45b3-a6d6-0c40c99ab1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e0f468-5c0e-4524-bbe5-8af299fe9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Volume ff7d1e47-098e-4336-a0f0-2a411b3534b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7', 'volume_size': 1} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-433898383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7d1e47-098e-4336-a0f0-2a411b3534b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af4cf8ef89e14b56bc933f98f748d78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:18Z,use_quota=True,user_id='17b2c0c591b4474494fe6484442e5184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Creating volume ff7d1e47-098e-4336-a0f0-2a411b3534b7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:18 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 1073741824 Jul 08 18:58:18 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:18 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd" returned: 0 in 0.873s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:18 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd Jul 08 18:58:18 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:18 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 1 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Downloaded image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 ((None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}])) to volume eafc7c8d-4cc2-415a-9401-8ced06ad1490 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Temporary image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 for user 70f570c2511c4b18ad6854d5dfd849c3 is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Marking volume eafc7c8d-4cc2-415a-9401-8ced06ad1490 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Copying metadata from image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 to eafc7c8d-4cc2-415a-9401-8ced06ad1490. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Creating volume glance metadata for volume eafc7c8d-4cc2-415a-9401-8ced06ad1490 backed by image 75ddc22d-e606-4e0e-803e-11f7c7d37ba3 with: {'image_id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c5d4520409cc19e6cf48523acc94fbbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6468aa-2eca-42d7-a29d-7c047e1fc5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490', 'volume_size': 1, 'image_id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5d4520409cc19e6cf48523acc94fbbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20105555142d4053b969b7968bb1c632', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '989d1c914040493759855fa8e0b8422fffbcd058f9c3867c3e0d9e084e9918c02cf7c3b0cb401d28404fedadd68fa01c783982a25e1d496421760b7b6ffa0c7b', 'id': '75ddc22d-e606-4e0e-803e-11f7c7d37ba3', 'created_at': datetime.datetime(2026, 7, 8, 16, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ddc22d-e606-4e0e-803e-11f7c7d37ba3/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17510f58-d014-4ecc-a27f-eaaee3ce4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:18 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Volume volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 (eafc7c8d-4cc2-415a-9401-8ced06ad1490): created successfully Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17510f58-d014-4ecc-a27f-eaaee3ce4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Flow 'volume_create_manager' (0f79634e-3f51-4483-8e71-868326de721a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c1f68e6f-e928-4664-8ba4-c41c116198ae tempest-VolumeImageDependencyTests-1924099573 None] Created volume successfully. Jul 08 18:58:19 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.793s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:58:19 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-71a7540f-6d88-4ed6-bf9c-c677051deffd" returned: 0 in 0.743s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-quobyte-71a7540f-6d88-4ed6-bf9c-c677051deffd" released by "delete_volume" :: held 1.669s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:19 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 1073741824" returned: 0 in 0.974s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Created reservations ['72ec083e-c08e-45ec-8afc-0d00ebbc3831', '161c3b40-9ec1-406c-838b-130603e1c01a', 'eaa58872-d74a-4eac-bb17-4c0f849e0e1d', '9420550f-9084-4711-912d-e3f511530a64'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:19 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 Jul 08 18:58:19 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:19 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:19 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:19 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7" returned: 0 in 0.695s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e0f468-5c0e-4524-bbe5-8af299fe9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907c9bab-79e4-46e3-b2ce-d62b0f1afcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:19 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Volume volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 (ff7d1e47-098e-4336-a0f0-2a411b3534b7): created successfully Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907c9bab-79e4-46e3-b2ce-d62b0f1afcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Flow 'volume_create_manager' (1ff956bf-9bed-46a1-9d41-a260a3e1c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5ac9cd2f-18b7-4129-9265-a6341f862329 tempest-VolumesListTestJSON-1208335622 None] Created volume successfully. Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Acquiring lock "cinder-eafc7c8d-4cc2-415a-9401-8ced06ad1490-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "cinder-eafc7c8d-4cc2-415a-9401-8ced06ad1490-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:20 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.821s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Acquiring lock "cinder-quobyte-eafc7c8d-4cc2-415a-9401-8ced06ad1490" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Deleted volume successfully. Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "cinder-quobyte-eafc7c8d-4cc2-415a-9401-8ced06ad1490" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e19ac5df-9f39-4a96-93b0-bd6dbec3489e tempest-CinderUnicodeTest-1075589464 None] Lock "cinder-71a7540f-6d88-4ed6-bf9c-c677051deffd-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca78699-6dc1-45ed-9b9f-4300e1fb3efe]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:20 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:20 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:21 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 0 in 0.975s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:21 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:21 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:21 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 1 in 0.863s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:58:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:21 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490 Jul 08 18:58:21 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-ff7d1e47-098e-4336-a0f0-2a411b3534b7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-ff7d1e47-098e-4336-a0f0-2a411b3534b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-quobyte-ff7d1e47-098e-4336-a0f0-2a411b3534b7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-ff7d1e47-098e-4336-a0f0-2a411b3534b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedabca9-1aed-4e90-9ec5-72ed7ee2ea75]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:22 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eafc7c8d-4cc2-415a-9401-8ced06ad1490" returned: 0 in 0.778s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "cinder-quobyte-eafc7c8d-4cc2-415a-9401-8ced06ad1490" released by "delete_volume" :: held 2.704s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Created reservations ['91219ede-9187-4430-84d2-768b0b9281bd', '0d725e76-f839-449c-908c-1a1091fdf478', '3d03d092-67b7-4bcc-9a5d-43c16632ccce', 'd6974fb0-239c-43c1-b3b5-69a8f976c879'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:22 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 Jul 08 18:58:22 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:22 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:22 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:23 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:23 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7 Jul 08 18:58:23 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:23 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.785s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Deleted volume successfully. Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-44e445dc-6e2d-4b7f-ac74-96fe33705c1a tempest-VolumeImageDependencyTests-1924099573 None] Lock "cinder-eafc7c8d-4cc2-415a-9401-8ced06ad1490-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Flow 'volume_create_manager' (5f9bb120-2e31-46ce-a0ba-183a17dcdb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb09418-f21f-43c5-bce7-aa455eec1ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb09418-f21f-43c5-bce7-aa455eec1ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998495321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda7b033-4f5b-44a7-979f-adfea27a35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caaaaa921154e33b689cc023bafaa24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:24Z,use_quota=True,user_id='0fd19d65d4f6423fbedb327cb3e91023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6727053-f1bf-4f8c-a375-26fc2b11caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6727053-f1bf-4f8c-a375-26fc2b11caab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65cabcc-5c86-4cba-a296-6ff765687c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65cabcc-5c86-4cba-a296-6ff765687c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda7b033-4f5b-44a7-979f-adfea27a35a7', 'volume_name': 'volume-cda7b033-4f5b-44a7-979f-adfea27a35a7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd70f1b-5108-48ed-b60d-2d4d6e02f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd70f1b-5108-48ed-b60d-2d4d6e02f797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623e042-4b42-4cf4-b223-19ba18202873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Volume cda7b033-4f5b-44a7-979f-adfea27a35a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda7b033-4f5b-44a7-979f-adfea27a35a7', 'volume_size': 1} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998495321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda7b033-4f5b-44a7-979f-adfea27a35a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caaaaa921154e33b689cc023bafaa24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:24Z,use_quota=True,user_id='0fd19d65d4f6423fbedb327cb3e91023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Creating volume cda7b033-4f5b-44a7-979f-adfea27a35a7 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:24 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:24 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 1073741824 Jul 08 18:58:24 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:24 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-ff7d1e47-098e-4336-a0f0-2a411b3534b7" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-ff7d1e47-098e-4336-a0f0-2a411b3534b7" released by "delete_volume" :: held 1.720s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Created reservations ['71feb9f4-9b0a-4c77-ab1b-3968db8e7d27', '06b9e90f-dd7d-4af6-99e7-36b1b2d5f8b1', 'a279f703-206c-41e3-a462-bb76327c6104', 'e4368087-329b-4b9d-b35a-b01a43972b73'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:24 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:24 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-56ce964f-1c79-4507-b35d-ccae2a251420-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:25 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 1073741824" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-56ce964f-1c79-4507-b35d-ccae2a251420-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-quobyte-56ce964f-1c79-4507-b35d-ccae2a251420" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:25 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 Jul 08 18:58:25 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-56ce964f-1c79-4507-b35d-ccae2a251420" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa97625-9c4b-4e90-a0eb-28e85f6729db]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:25 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 Jul 08 18:58:25 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:25 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Deleted volume successfully. Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b50916e0-e685-4d0f-a3e6-f4675a4dea31 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-ff7d1e47-098e-4336-a0f0-2a411b3534b7-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:25 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7" returned: 0 in 0.806s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623e042-4b42-4cf4-b223-19ba18202873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda7b033-4f5b-44a7-979f-adfea27a35a7', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f70428-4975-4da7-b01f-7fb0d612ffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Volume volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 (cda7b033-4f5b-44a7-979f-adfea27a35a7): created successfully Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f70428-4975-4da7-b01f-7fb0d612ffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Flow 'volume_create_manager' (5f9bb120-2e31-46ce-a0ba-183a17dcdb7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f39d7ffb-2bf2-435f-ba10-be9f1ae7a770 tempest-ProjectReaderTests-156561969 None] Created volume successfully. Jul 08 18:58:26 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420" returned: 0 in 0.892s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:26 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420 Jul 08 18:58:26 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:26 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-56ce964f-1c79-4507-b35d-ccae2a251420" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-56ce964f-1c79-4507-b35d-ccae2a251420" released by "delete_volume" :: held 1.622s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:26 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Created reservations ['f91ebd35-51cf-4f7c-bbf0-ccdc7cca7ac6', '2ea0be87-8fec-4f19-9fbe-ebf827065a8a', 'd14f5cb7-e9c3-40a2-9d1a-20cd77176d64', 'f9ff1be4-9ef9-4d6b-8f9d-d0b9d631d06e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:27 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Acquiring lock "cinder-cda7b033-4f5b-44a7-979f-adfea27a35a7-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "cinder-cda7b033-4f5b-44a7-979f-adfea27a35a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-f96e99e8-0e01-48a3-bb79-d6e2a8478d65-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-f96e99e8-0e01-48a3-bb79-d6e2a8478d65-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Acquiring lock "cinder-quobyte-cda7b033-4f5b-44a7-979f-adfea27a35a7" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "cinder-quobyte-cda7b033-4f5b-44a7-979f-adfea27a35a7" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c97e6ba-a3ff-47ed-ad37-c5d897f24921]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "cinder-quobyte-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99353d0-499e-4b8b-b80d-454c74356b5b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:27 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 Jul 08 18:58:27 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:27 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:27 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Deleted volume successfully. Jul 08 18:58:27 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 Jul 08 18:58:27 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e9d739b7-8cdd-4055-a419-3c2b626c2403 tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-56ce964f-1c79-4507-b35d-ccae2a251420-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:28 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7" returned: 0 in 0.895s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:28 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7 Jul 08 18:58:28 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:28 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" returned: 0 in 0.875s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:28 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65 Jul 08 18:58:28 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:29 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cda7b033-4f5b-44a7-979f-adfea27a35a7" returned: 0 in 0.727s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "cinder-quobyte-cda7b033-4f5b-44a7-979f-adfea27a35a7" released by "delete_volume" :: held 1.670s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:29 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" returned: 0 in 0.717s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-quobyte-f96e99e8-0e01-48a3-bb79-d6e2a8478d65" released by "delete_volume" :: held 1.632s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Created reservations ['52e5230c-b6fd-4c75-8fe1-8115d424406e', 'a9240264-71fd-4057-a993-653cac7c6a47', '1d6e2f14-8b34-4f32-9f27-aaf218e56e52', 'b5f94594-29f1-4673-9134-0fd12efc97bc'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:29 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Created reservations ['5ab225b5-2e89-4b2e-a4c3-5b0802a465a4', 'e92ce6c5-ec14-42fb-bb54-b165a1c0d1e0', 'dcaac550-518d-4970-adf6-ada18230595a', 'e9fc837e-01e4-4fad-a004-052307b12463'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:30 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:30 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:30 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:30 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:30 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:30 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Deleted volume successfully. Jul 08 18:58:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b70b90a9-f244-4cd9-89ad-4f72f30d7308 tempest-ProjectReaderTests-156561969 None] Lock "cinder-cda7b033-4f5b-44a7-979f-adfea27a35a7-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:31 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Deleted volume successfully. Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9de0a05-f3ad-4643-808e-4a2ca16607fd tempest-VolumesListTestJSON-1208335622 None] Lock "cinder-f96e99e8-0e01-48a3-bb79-d6e2a8478d65-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Flow 'volume_create_manager' (95222bf7-7d2d-4158-9ada-b7c2a4d5f61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439880d9-b597-4e63-a305-ee04a15b0978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439880d9-b597-4e63-a305-ee04a15b0978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789432108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c51966-d4b0-436f-88ec-3f9bc51990dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caaaaa921154e33b689cc023bafaa24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:31Z,use_quota=True,user_id='0fd19d65d4f6423fbedb327cb3e91023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c92ed3e-77b0-4589-b3a6-fa556df3c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c92ed3e-77b0-4589-b3a6-fa556df3c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e83a23e-6dd0-4278-9028-e818b9aac4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e83a23e-6dd0-4278-9028-e818b9aac4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c51966-d4b0-436f-88ec-3f9bc51990dd', 'volume_name': 'volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48321cc5-48f1-4472-befc-81e344bdd1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48321cc5-48f1-4472-befc-81e344bdd1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c4883-c582-4601-938a-7bb07bf2366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:31 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Volume e7c51966-d4b0-436f-88ec-3f9bc51990dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd', 'volume_size': 1} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789432108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c51966-d4b0-436f-88ec-3f9bc51990dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caaaaa921154e33b689cc023bafaa24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:31Z,use_quota=True,user_id='0fd19d65d4f6423fbedb327cb3e91023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Creating volume e7c51966-d4b0-436f-88ec-3f9bc51990dd {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:31 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:31 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd 1073741824 Jul 08 18:58:31 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:32 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd 1073741824" returned: 0 in 1.039s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:32 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=155,cinder:UPDATE=199,cinder:INSERT=54,cinder:DELETE=15 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:58:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:32 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd Jul 08 18:58:32 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:33 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c4883-c582-4601-938a-7bb07bf2366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6868a32b-31c0-457e-9dbd-8e705e7d7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Volume volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd (e7c51966-d4b0-436f-88ec-3f9bc51990dd): created successfully Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6868a32b-31c0-457e-9dbd-8e705e7d7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Flow 'volume_create_manager' (95222bf7-7d2d-4158-9ada-b7c2a4d5f61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a4b85c90-e838-4dca-b880-e3c7272729f8 tempest-ProjectReaderTests-156561969 None] Created volume successfully. Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Flow 'volume_create_manager' (bf2e0c10-5423-4ad8-b007-ef6fbb9f766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16efaf25-5ffe-439e-b927-298fe5a26e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16efaf25-5ffe-439e-b927-298fe5a26e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1600420011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1f8416-7376-4cad-afa6-203c460752f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adee36cc5b134f4eaf7949029fab0975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:34Z,use_quota=True,user_id='151071860bfa4b4092481c669aec5664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccbae14-c013-4a09-be0f-7b5b7149a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccbae14-c013-4a09-be0f-7b5b7149a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110826a3-abcd-47ac-8770-61c34c098a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110826a3-abcd-47ac-8770-61c34c098a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1f8416-7376-4cad-afa6-203c460752f1', 'volume_name': 'volume-cc1f8416-7376-4cad-afa6-203c460752f1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f23be-4806-40d8-85ec-a3f573c4df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3f23be-4806-40d8-85ec-a3f573c4df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f27bb0-bea6-440e-bc3f-b0d0dfe230c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Volume cc1f8416-7376-4cad-afa6-203c460752f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1f8416-7376-4cad-afa6-203c460752f1', 'volume_size': 1} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1600420011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1f8416-7376-4cad-afa6-203c460752f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adee36cc5b134f4eaf7949029fab0975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:34Z,use_quota=True,user_id='151071860bfa4b4092481c669aec5664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Creating volume cc1f8416-7376-4cad-afa6-203c460752f1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:34 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:34 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 1073741824 Jul 08 18:58:34 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Acquiring lock "cinder-e7c51966-d4b0-436f-88ec-3f9bc51990dd-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "cinder-e7c51966-d4b0-436f-88ec-3f9bc51990dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Acquiring lock "cinder-quobyte-e7c51966-d4b0-436f-88ec-3f9bc51990dd" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "cinder-quobyte-e7c51966-d4b0-436f-88ec-3f9bc51990dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[097165cf-91cb-4f1a-92ba-c529d9393b96]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:34 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd Jul 08 18:58:34 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:35 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 1073741824" returned: 0 in 1.103s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:35 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 Jul 08 18:58:35 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:35 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd" returned: 0 in 1.002s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:35 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd Jul 08 18:58:35 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:36 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1" returned: 0 in 0.697s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f27bb0-bea6-440e-bc3f-b0d0dfe230c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1f8416-7376-4cad-afa6-203c460752f1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975884b4-d218-494f-8c61-8ff0e5f01c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Volume volume-cc1f8416-7376-4cad-afa6-203c460752f1 (cc1f8416-7376-4cad-afa6-203c460752f1): created successfully Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975884b4-d218-494f-8c61-8ff0e5f01c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Flow 'volume_create_manager' (bf2e0c10-5423-4ad8-b007-ef6fbb9f766b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-618c807e-3ac3-4416-b3fa-5ba9dc2be6f1 tempest-VolumesNegativeTest-628615302 None] Created volume successfully. Jul 08 18:58:36 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e7c51966-d4b0-436f-88ec-3f9bc51990dd" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "cinder-quobyte-e7c51966-d4b0-436f-88ec-3f9bc51990dd" released by "delete_volume" :: held 1.810s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Created reservations ['0f7ab043-2a2e-4660-9483-ff5b4facda68', 'ae0769a6-c0df-4f4e-bc93-b8ac23fa6965', 'b9cb75c5-c4dc-40a1-9fe8-4a9245a7a4fe', '6bb4203b-10c3-4416-9e03-d1fd8a611696'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:36 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:58:36 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:37 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.908s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:37 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:58:37 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Deleted volume successfully. Jul 08 18:58:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-aad82bab-004f-4990-a0b2-ae8d86c030e0 tempest-ProjectReaderTests-156561969 None] Lock "cinder-e7c51966-d4b0-436f-88ec-3f9bc51990dd-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:58:46 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=14,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:58:47 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=185,cinder:SELECT=118,cinder:INSERT=48,cinder:DELETE=16 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Flow 'volume_create_manager' (fe1f0898-926e-4a4d-9344-9968634b9be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc485555-721b-4e18-ae03-8f1936822b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc485555-721b-4e18-ae03-8f1936822b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-980074441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12499d7-f0c4-45d3-8409-09037ebda3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951eb21d3ff64a24b4e9b9f839173945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:57Z,use_quota=True,user_id='373d4fb0e09f4587a05ba8faa7bdae52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08116206-1c15-4922-b011-889db06c17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08116206-1c15-4922-b011-889db06c17c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a1d938-b18e-4705-8d69-ee439b1af37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a1d938-b18e-4705-8d69-ee439b1af37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12499d7-f0c4-45d3-8409-09037ebda3d8', 'volume_name': 'volume-b12499d7-f0c4-45d3-8409-09037ebda3d8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7697fc3-1e24-438f-a551-47a8b536bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7697fc3-1e24-438f-a551-47a8b536bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab29d3-350c-4b6f-b30c-ed5f7971836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:56 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Volume b12499d7-f0c4-45d3-8409-09037ebda3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12499d7-f0c4-45d3-8409-09037ebda3d8', 'volume_size': 1} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-980074441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12499d7-f0c4-45d3-8409-09037ebda3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951eb21d3ff64a24b4e9b9f839173945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:58:57Z,use_quota=True,user_id='373d4fb0e09f4587a05ba8faa7bdae52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Creating volume b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:58:57 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:57 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 1073741824 Jul 08 18:58:57 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:57 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 1073741824" returned: 0 in 0.974s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:58 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:58:58 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:58:58 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab29d3-350c-4b6f-b30c-ed5f7971836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12499d7-f0c4-45d3-8409-09037ebda3d8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef70a487-884c-4d5d-b374-8cf455ae593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:58:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Volume volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 (b12499d7-f0c4-45d3-8409-09037ebda3d8): created successfully Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef70a487-884c-4d5d-b374-8cf455ae593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:58:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Flow 'volume_create_manager' (fe1f0898-926e-4a4d-9344-9968634b9be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:58:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-039c5bd7-8c11-41e2-aac0-94bffccb2a2f tempest-SnapshotDependencyTests-1020729040 None] Created volume successfully. Jul 08 18:58:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:58:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:58:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Creating offline snapshot 0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 of volume b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:58:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e323e3-c66d-43aa-aad6-3950d32c6cac]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:58:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:58:59 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:58:59 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:00 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:00 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 1G Jul 08 18:59:00 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:00 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 1G" returned: 0 in 0.790s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:00 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:00 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:01 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.712s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:01 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 is being set with open permissions: ugo+rw Jul 08 18:59:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:01 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:01 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:02 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.643s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:02 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info Jul 08 18:59:02 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:02 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info" returned: 0 in 0.651s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:02 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info is being set with open permissions: ugo+rw Jul 08 18:59:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:02 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info Jul 08 18:59:02 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:03 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.info" returned: 0 in 0.652s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-17d25117-be70-487b-a4c6-080a6ecf5195 tempest-SnapshotDependencyTests-1020729040 None] Create snapshot completed successfully Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Flow 'volume_create_manager' (cc8d38a6-a4f9-448b-bf5e-6572bb49d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad68f0e1-a953-45b0-a0eb-fd74e2b3336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad68f0e1-a953-45b0-a0eb-fd74e2b3336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d66e29-7b25-4883-b2a6-f7799d987670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951eb21d3ff64a24b4e9b9f839173945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0370a99a-9cc5-4358-bdc7-0fad45b2c9f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:05Z,use_quota=True,user_id='373d4fb0e09f4587a05ba8faa7bdae52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e622449-affb-49de-95a1-52bc298922df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e622449-affb-49de-95a1-52bc298922df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace9272b-b06c-4eed-96f8-045ed3b398bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace9272b-b06c-4eed-96f8-045ed3b398bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17d66e29-7b25-4883-b2a6-f7799d987670', 'volume_name': 'volume-17d66e29-7b25-4883-b2a6-f7799d987670', 'volume_size': 1, 'snapshot_id': '0370a99a-9cc5-4358-bdc7-0fad45b2c9f9'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554d8976-e229-4aac-a758-b68ca6473f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554d8976-e229-4aac-a758-b68ca6473f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e815c73-93a7-4ab1-a884-6a8d00759856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Volume 17d66e29-7b25-4883-b2a6-f7799d987670: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17d66e29-7b25-4883-b2a6-f7799d987670', 'volume_size': 1, 'snapshot_id': '0370a99a-9cc5-4358-bdc7-0fad45b2c9f9'} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-17d66e29-7b25-4883-b2a6-f7799d987670" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-17d66e29-7b25-4883-b2a6-f7799d987670" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Creating volume 17d66e29-7b25-4883-b2a6-f7799d987670 from snapshot 0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] snapshot: 0370a99a-9cc5-4358-bdc7-0fad45b2c9f9, volume: 17d66e29-7b25-4883-b2a6-f7799d987670, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6443e78f-8039-411d-a04d-093f44da568b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:05 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:05 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:06 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.837s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b12499d7-f0c4-45d3-8409-09037ebda3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca9182-2e23-4eb4-9d22-f2e309d25753]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:06 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:59:06 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:06 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.784s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:59:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:06 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 Jul 08 18:59:06 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Acquiring lock "cinder-cc1f8416-7376-4cad-afa6-203c460752f1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "cinder-cc1f8416-7376-4cad-afa6-203c460752f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Acquiring lock "cinder-quobyte-cc1f8416-7376-4cad-afa6-203c460752f1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "cinder-quobyte-cc1f8416-7376-4cad-afa6-203c460752f1" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f008311-86dd-4890-9dcf-a5a21d11d4f7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:10 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 Jul 08 18:59:10 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:11 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1" returned: 0 in 1.402s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:11 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1 Jul 08 18:59:11 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:12 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670" returned: 0 in 5.422s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452ae6a-835b-4489-94dd-9c423eee1d43]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:12 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:59:12 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:12 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-cc1f8416-7376-4cad-afa6-203c460752f1" returned: 0 in 1.337s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "cinder-quobyte-cc1f8416-7376-4cad-afa6-203c460752f1" released by "delete_volume" :: held 2.821s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Created reservations ['e07c5728-37dc-4123-b1fd-e4601739d715', 'df20e9aa-28ac-4439-89ea-66fdf9574b1f', '9c9e6b0a-75fe-4605-99f2-ca7140cfb038', '0cc32bb6-4d66-4689-823a-e4a7df345335'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:12 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:59:12 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:13 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 1.019s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:59:13 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Converted 1024.00 MB image at 188.79 MB/s Jul 08 18:59:13 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 is being set with open permissions: ugo+rw Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:13 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 Jul 08 18:59:13 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:13 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.696s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Deleted volume successfully. Jul 08 18:59:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78f06ce5-eb52-4a5d-a8f1-2ca089b459d4 tempest-VolumesNegativeTest-628615302 None] Lock "cinder-cc1f8416-7376-4cad-afa6-203c460752f1-delete_volume" released by "delete_volume" :: held 3.804s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:14 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670" returned: 0 in 0.659s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" released by "_copy_volume_from_snapshot" :: held 8.813s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-17d66e29-7b25-4883-b2a6-f7799d987670" released by "_create_volume_from_snapshot" :: held 8.841s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.857s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e815c73-93a7-4ab1-a884-6a8d00759856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d66e29-7b25-4883-b2a6-f7799d987670', 'volume_size': 1, 'snapshot_id': '0370a99a-9cc5-4358-bdc7-0fad45b2c9f9'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b7ab80-6375-45db-9781-3ed1659c12fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Volume volume-17d66e29-7b25-4883-b2a6-f7799d987670 (17d66e29-7b25-4883-b2a6-f7799d987670): created successfully Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b7ab80-6375-45db-9781-3ed1659c12fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Flow 'volume_create_manager' (cc8d38a6-a4f9-448b-bf5e-6572bb49d37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1299cda0-7408-4f60-9adb-9e77a9fd3432 tempest-SnapshotDependencyTests-1020729040 None] Created volume successfully. Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Deleting offline snapshot 0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 of volume b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] snapshot_file for this snap is: volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5b3e18-4191-4d62-90c6-c4a6039bd5d8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:15 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Flow 'volume_create_manager' (c01c5135-20c9-41a9-9547-e5a284b5d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e41caf-eda6-41cf-ba7c-3bd658dda7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e41caf-eda6-41cf-ba7c-3bd658dda7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1094476154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aceaa1b-d7ec-45c2-9457-3c0b7da59769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97355fdeee8342b9a8901e4b105072b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:16Z,use_quota=True,user_id='ff95e7b0cacc45d5a5905397cee5cf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116de723-87c0-4b7b-9141-545ce3171215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116de723-87c0-4b7b-9141-545ce3171215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa65113-e442-45b7-8235-7ea14c5bf9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa65113-e442-45b7-8235-7ea14c5bf9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aceaa1b-d7ec-45c2-9457-3c0b7da59769', 'volume_name': 'volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d843b9-7abc-4026-93a2-46116c6d9ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:15 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d843b9-7abc-4026-93a2-46116c6d9ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9872c4bf-d7f9-4c05-b73a-d5591c381e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769', 'volume_size': 1} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1094476154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aceaa1b-d7ec-45c2-9457-3c0b7da59769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97355fdeee8342b9a8901e4b105072b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:59:16Z,use_quota=True,user_id='ff95e7b0cacc45d5a5905397cee5cf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Creating volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:59:15 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b12499d7-f0c4-45d3-8409-09037ebda3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:15 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 1073741824 Jul 08 18:59:15 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0511cd-81c1-4ba3-a4ca-4464604445e5]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:15 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:59:15 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:16 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 1073741824" returned: 0 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:16 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.789s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:16 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:16 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:16 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 Jul 08 18:59:16 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:17 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9872c4bf-d7f9-4c05-b73a-d5591c381e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e738957-e5f0-46bf-9051-0b91a94a5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:59:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Volume volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 (9aceaa1b-d7ec-45c2-9457-3c0b7da59769): created successfully Jul 08 18:59:17 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e738957-e5f0-46bf-9051-0b91a94a5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Flow 'volume_create_manager' (c01c5135-20c9-41a9-9547-e5a284b5d741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b6887ce7-0fcd-44cc-b69f-0547385f43e4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Created volume successfully. Jul 08 18:59:17 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9 Jul 08 18:59:17 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Creating offline snapshot 2af67982-339f-4ae4-83bc-1ae3cfd8ba81 of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0899dae-79da-4117-9687-e6506a723be2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8.0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" returned: 0 in 0.662s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9" released by "_delete_snapshot" :: held 3.123s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" released by "delete_snapshot" :: held 3.146s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:18 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 Jul 08 18:59:18 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:59:18 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Created reservations ['e7642705-3357-479f-9393-2bbaec25e574', 'd9ef3434-38e4-4338-8cd2-8aa43cb3561b', 'c46549bd-2883-4819-aa05-044894657ad5', '06e2c102-21a1-4b51-ac5e-3339abd235b8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Delete snapshot completed successfully. Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2bc40e57-62e1-4413-b0cc-bb96f0e4c02a tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-0370a99a-9cc5-4358-bdc7-0fad45b2c9f9-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:18 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:18 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 1G Jul 08 18:59:18 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:18 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.667s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:59:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-b12499d7-f0c4-45d3-8409-09037ebda3d8-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-b12499d7-f0c4-45d3-8409-09037ebda3d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8711dbb-9224-43c4-8280-cc13c68e7324]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:19 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:59:19 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:19 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 1G" returned: 0 in 0.799s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:19 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:19 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.803s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8 Jul 08 18:59:20 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.684s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 is being set with open permissions: ugo+rw Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:20 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b12499d7-f0c4-45d3-8409-09037ebda3d8" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-b12499d7-f0c4-45d3-8409-09037ebda3d8" released by "delete_volume" :: held 1.540s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Created reservations ['c2616ddc-4421-483a-b5dd-07a722f920de', 'c20a8ebc-1eba-41ff-bb8a-4a937beabd90', '8e06231f-26eb-46db-9b60-1de77fbd043a', 'bb7348fe-6df4-42cd-953b-95432a694473'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:20 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.657s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:20 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:59:20 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:21 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info Jul 08 18:59:21 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-17d66e29-7b25-4883-b2a6-f7799d987670-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-17d66e29-7b25-4883-b2a6-f7799d987670-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d50c2b-d7d2-49dd-9ca0-3d1a6fb908c9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:21 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.665s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Deleted volume successfully. Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19d147f9-7acb-473d-9817-02ca7100f3a2 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-b12499d7-f0c4-45d3-8409-09037ebda3d8-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:21 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 Jul 08 18:59:21 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:21 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:21 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info is being set with open permissions: ugo+rw Jul 08 18:59:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:21 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info Jul 08 18:59:21 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670" returned: 0 in 0.778s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:22 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.info" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:22 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670 Jul 08 18:59:22 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c1fbb9ed-3041-4a88-b876-60c48722a3f4 tempest-VolumesSnapshotListTestJSON-1842105080 None] Create snapshot completed successfully Jul 08 18:59:23 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-17d66e29-7b25-4883-b2a6-f7799d987670" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-quobyte-17d66e29-7b25-4883-b2a6-f7799d987670" released by "delete_volume" :: held 1.496s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Created reservations ['9d61c391-2d50-4696-b1b1-0f644a2c6a55', '71eacc16-d32b-4961-98e8-3fc5714ebc6c', '5291c842-463b-4456-b8fc-3de0f23d64d9', 'f44a1754-3e4a-4d6a-a535-3718589f68f9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:23 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:59:23 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Creating offline snapshot 01539c97-31e8-463f-b31d-8f436b2d94f8 of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b16fdaa-06d6-4141-8dd4-4d09083d409b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:23 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:23 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:23 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Deleted volume successfully. Jul 08 18:59:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-cebe147a-c835-442d-a378-3c6539c65fd0 tempest-SnapshotDependencyTests-1020729040 None] Lock "cinder-17d66e29-7b25-4883-b2a6-f7799d987670-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:24 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.790s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:24 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 1G Jul 08 18:59:24 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:25 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 1G" returned: 0 in 0.870s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:25 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:25 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:25 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:25 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 is being set with open permissions: ugo+rw Jul 08 18:59:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:25 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:25 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:26 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.713s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:26 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-abf8f816-fa0c-4cc7-aa5e-316dfe7f9423 tempest-VolumesSnapshotListTestJSON-1842105080 None] Create snapshot completed successfully Jul 08 18:59:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Creating offline snapshot 56239eee-9489-44c6-af44-edf05e26052b of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:59:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[420658eb-0342-4f4f-93f7-95656985c8df]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:27 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:27 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:28 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.805s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:28 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b 1G Jul 08 18:59:28 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:29 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b 1G" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:29 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b Jul 08 18:59:29 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:30 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:30 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b is being set with open permissions: ugo+rw Jul 08 18:59:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:30 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b Jul 08 18:59:30 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:31 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8e0ef9f6-9efc-439a-8a22-9d077236d6dc tempest-VolumesSnapshotListTestJSON-1842105080 None] Create snapshot completed successfully Jul 08 18:59:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-56239eee-9489-44c6-af44-edf05e26052b-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-56239eee-9489-44c6-af44-edf05e26052b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-56239eee-9489-44c6-af44-edf05e26052b" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-56239eee-9489-44c6-af44-edf05e26052b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Deleting offline snapshot 56239eee-9489-44c6-af44-edf05e26052b of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] snapshot_file for this snap is: volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e114ee9d-8010-4ea6-b666-44af7b7b7955]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:33 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b Jul 08 18:59:33 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:33 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b" returned: 0 in 0.746s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d0596-ae6f-4c03-9d29-57d6d11c4596]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:33 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:33 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:34 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.766s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:34 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b Jul 08 18:59:34 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:35 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:35 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b Jul 08 18:59:35 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:35 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.56239eee-9489-44c6-af44-edf05e26052b" returned: 0 in 0.631s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-56239eee-9489-44c6-af44-edf05e26052b" released by "_delete_snapshot" :: held 3.011s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" released by "delete_snapshot" :: held 3.032s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Created reservations ['bfcf2845-dae6-4413-82d3-36739fa6eb3b', 'ba67ae9e-b757-4364-b0a5-b1d6ec01d2cd', '8c76a350-35bf-496f-9811-3ff3ecdfd2f0', '55d1df57-4a83-4fc9-8c2a-9ec7def5ed0c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Delete snapshot completed successfully. Jul 08 18:59:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-53258441-d40d-4001-9cf7-53a753194911 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-56239eee-9489-44c6-af44-edf05e26052b-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-01539c97-31e8-463f-b31d-8f436b2d94f8-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-01539c97-31e8-463f-b31d-8f436b2d94f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-01539c97-31e8-463f-b31d-8f436b2d94f8" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-01539c97-31e8-463f-b31d-8f436b2d94f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Deleting offline snapshot 01539c97-31e8-463f-b31d-8f436b2d94f8 of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] snapshot_file for this snap is: volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ce8aa-f289-4c83-88d7-7fae95e64c89]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:37 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:37 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:37 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c46e49-9577-4243-92dd-6c5c1e97da0a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:38 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:38 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:38 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:38 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:38 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:39 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:39 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8 Jul 08 18:59:39 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:40 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.01539c97-31e8-463f-b31d-8f436b2d94f8" returned: 0 in 0.636s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-01539c97-31e8-463f-b31d-8f436b2d94f8" released by "_delete_snapshot" :: held 2.952s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" released by "delete_snapshot" :: held 2.974s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Created reservations ['650f5971-6de0-4d4d-84c9-80b30a22a1e2', '587c72d2-7d8a-4bd5-826f-92806ff98b0d', '5b7ac553-903b-40a6-9e84-136652927fa9', '994841de-95e6-4c09-9f0e-3a96900af43f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Delete snapshot completed successfully. Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c2d3a993-cd73-4bd6-8293-86ef4d447695 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-01539c97-31e8-463f-b31d-8f436b2d94f8-delete_snapshot" released by "delete_snapshot" :: held 3.101s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-2af67982-339f-4ae4-83bc-1ae3cfd8ba81-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-2af67982-339f-4ae4-83bc-1ae3cfd8ba81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-2af67982-339f-4ae4-83bc-1ae3cfd8ba81" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-2af67982-339f-4ae4-83bc-1ae3cfd8ba81" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Deleting offline snapshot 2af67982-339f-4ae4-83bc-1ae3cfd8ba81 of volume 9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] snapshot_file for this snap is: volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed815f4c-6411-4366-abb5-d199a10f52d2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:40 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:40 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:41 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.738s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a52b63-4ce0-454d-a4f3-759f78850b6e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:41 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 Jul 08 18:59:41 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:41 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" returned: 0 in 0.732s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:41 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:41 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:42 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.699s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:42 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81 Jul 08 18:59:42 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:43 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769.2af67982-339f-4ae4-83bc-1ae3cfd8ba81" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-2af67982-339f-4ae4-83bc-1ae3cfd8ba81" released by "_delete_snapshot" :: held 2.917s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" released by "delete_snapshot" :: held 2.939s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Created reservations ['83332b41-9b3d-4044-89d1-9d81fd33a5f8', '3ef3e88f-d8f3-434a-99b8-ffa6e45a09a6', 'cd373c95-7fbb-4e63-aab0-303d57995487', '4c17260e-dc93-4a19-ab47-2bba87f50874'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Delete snapshot completed successfully. Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-126e7b7a-5473-4c3e-9d2f-5774187ff821 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-2af67982-339f-4ae4-83bc-1ae3cfd8ba81-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-9aceaa1b-d7ec-45c2-9457-3c0b7da59769-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-9aceaa1b-d7ec-45c2-9457-3c0b7da59769-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" acquired by "delete_volume" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[699549bc-beef-4e50-9a96-6a445f790e59]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:59:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:43 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 Jul 08 18:59:43 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:44 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:44 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769 Jul 08 18:59:44 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:45 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" returned: 0 in 0.642s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-quobyte-9aceaa1b-d7ec-45c2-9457-3c0b7da59769" released by "delete_volume" :: held 1.458s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Created reservations ['0708fc0d-18a3-45e5-bfa6-9ecd30aaed64', 'de8b622e-0385-4519-9915-f67e7525af55', 'b7f1e7fb-30a4-4246-b923-6b528967af7b', '08999cd6-3d16-437d-b8cf-71071d419288'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:59:45 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 18:59:45 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:59:45 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.642s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:59:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Deleted volume successfully. Jul 08 18:59:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-315e2aa9-7396-4a50-b521-9d0d892d01e3 tempest-VolumesSnapshotListTestJSON-1842105080 None] Lock "cinder-9aceaa1b-d7ec-45c2-9457-3c0b7da59769-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:59:55 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=70,cinder:SELECT=63,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:59:55 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Flow 'volume_create_manager' (fdb349fa-a9c6-484a-803c-0eae9bed2df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f73127-e44c-4372-a6d6-179947ea869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f73127-e44c-4372-a6d6-179947ea869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-321228241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae6fea5-a875-4cca-acd3-87ae2ba73f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b527d7161b649f8ac9ca1b636da3ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:05Z,use_quota=True,user_id='43a41f8f5d6747659f361c4225788c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908c3a6f-ddf8-4728-afd9-d6ea76bfbf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908c3a6f-ddf8-4728-afd9-d6ea76bfbf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee992a0-807a-477c-8e3b-803705142439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee992a0-807a-477c-8e3b-803705142439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae6fea5-a875-4cca-acd3-87ae2ba73f50', 'volume_name': 'volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22416626-5549-4ef3-ac11-64a9c50c44d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22416626-5549-4ef3-ac11-64a9c50c44d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0197756a-4fbb-461e-8ff8-cb65f89203c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume eae6fea5-a875-4cca-acd3-87ae2ba73f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50', 'volume_size': 1} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-321228241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae6fea5-a875-4cca-acd3-87ae2ba73f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b527d7161b649f8ac9ca1b636da3ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:05Z,use_quota=True,user_id='43a41f8f5d6747659f361c4225788c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Creating volume eae6fea5-a875-4cca-acd3-87ae2ba73f50 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:05 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:05 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 1073741824 Jul 08 19:00:05 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Flow 'volume_create_manager' (5fe7a3a5-1849-4b16-ac37-65166df81a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a665e97e-c7b7-45a8-baa1-fe4d9eca1ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a665e97e-c7b7-45a8-baa1-fe4d9eca1ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-53508911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b527d7161b649f8ac9ca1b636da3ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:06Z,use_quota=True,user_id='43a41f8f5d6747659f361c4225788c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21038b0-c4d0-474a-a7a6-987a9f4b9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21038b0-c4d0-474a-a7a6-987a9f4b9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3288a96-237a-414d-bcf2-d0a070bb7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3288a96-237a-414d-bcf2-d0a070bb7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8', 'volume_name': 'volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e097c0-c985-44c8-8de3-be206a35a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e097c0-c985-44c8-8de3-be206a35a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85d678-0e93-4ea8-997e-7702666d9fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8', 'volume_size': 1} Jul 08 19:00:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:06 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 1073741824" returned: 0 in 0.924s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:06 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 Jul 08 19:00:06 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:07 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50" returned: 0 in 0.679s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-53508911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b527d7161b649f8ac9ca1b636da3ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:00:06Z,use_quota=True,user_id='43a41f8f5d6747659f361c4225788c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Creating volume e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:00:07 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:07 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 1073741824 Jul 08 19:00:07 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0197756a-4fbb-461e-8ff8-cb65f89203c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68247dec-c9e5-4a9f-882a-f3cf69253c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 (eae6fea5-a875-4cca-acd3-87ae2ba73f50): created successfully Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68247dec-c9e5-4a9f-882a-f3cf69253c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Flow 'volume_create_manager' (fdb349fa-a9c6-484a-803c-0eae9bed2df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-178ed5f6-b026-4deb-bf5d-b2fc9d1a43ff tempest-TestServerVolumeAttachmentScenario-2081703063 None] Created volume successfully. Jul 08 19:00:07 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 1073741824" returned: 0 in 0.919s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:08 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 Jul 08 19:00:08 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:08 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b85d678-0e93-4ea8-997e-7702666d9fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb79c07-5106-4dc3-adf7-152015e8fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:00:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Volume volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 (e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8): created successfully Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb79c07-5106-4dc3-adf7-152015e8fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:00:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Flow 'volume_create_manager' (5fe7a3a5-1849-4b16-ac37-65166df81a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:00:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a6887a2f-a693-4ea1-8c93-962b5b34ffde tempest-TestServerVolumeAttachmentScenario-2081703063 None] Created volume successfully. Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:18 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:00:18 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:18 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.734s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:00:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:00:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:00:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b9ca65-d3d3-40f8-99df-b999d29ec065]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:47 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 Jul 08 19:00:47 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:48 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50" returned: 0 in 0.774s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d83e93f-8507-40d5-b6d4-5f7a595400fe', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 19:00:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-99f1d37e-1c76-4bd8-9c3f-5bd3ead75e6d req-19c1e570-0987-46a1-b1ad-39f366488055 tempest-TestServerVolumeAttachmentScenario-2081703063 None] attachment_update completed successfully. Jul 08 19:00:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:00:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:00:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aff968-a4c7-4aed-a4ac-70e5a3fd6909]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:00:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:00:57 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 Jul 08 19:00:57 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:00:57 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 08 19:00:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" returned: 0 in 0.771s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:00:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:00:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c850c840-dcf4-4020-9c48-eb2ed6eb9aa1', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 19:00:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-8242b8d4-98a1-45cb-859f-b25ba51667ae req-211c9dea-ed10-47e6-a005-0ca4f5c0cffc tempest-TestServerVolumeAttachmentScenario-2081703063 None] attachment_update completed successfully. Jul 08 19:01:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-25fa69d0-bedc-4dc2-93e0-c841e6cd1ad5 req-ad9577c6-fb0b-4df4-96bb-d20dc83180a5 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Terminate volume connection completed successfully. Jul 08 19:01:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-25fa69d0-bedc-4dc2-93e0-c841e6cd1ad5 req-ad9577c6-fb0b-4df4-96bb-d20dc83180a5 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Deleting attachment c850c840-dcf4-4020-9c48-eb2ed6eb9aa1. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 19:01:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-c211f0a5-d2a8-487b-a93c-0e17def3ac4f req-f8511a5c-3ae3-4a38-962a-8f2337968b8c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Terminate volume connection completed successfully. Jul 08 19:01:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-c211f0a5-d2a8-487b-a93c-0e17def3ac4f req-f8511a5c-3ae3-4a38-962a-8f2337968b8c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Deleting attachment 5d83e93f-8507-40d5-b6d4-5f7a595400fe. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "cinder-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "cinder-quobyte-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-quobyte-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[439bf921-196a-4a69-b0d7-fd526a608e51]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:17 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 Jul 08 19:01:17 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:18 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:18 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:01:18 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:18 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8 Jul 08 19:01:18 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:18 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" returned: 0 in 0.645s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:18 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-quobyte-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8" released by "delete_volume" :: held 1.446s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:01:18 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Created reservations ['b6d379f8-b9ee-4419-8c28-118546d83572', 'f482ab8b-3fe1-4ba4-ab21-55333e2fd4e5', '2c687240-e3af-4e31-a8b3-5dc77034c87f', '003eaa1e-4bb7-40e8-ac44-b34ba4dce189'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:19 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:01:19 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "cinder-eae6fea5-a875-4cca-acd3-87ae2ba73f50-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-eae6fea5-a875-4cca-acd3-87ae2ba73f50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "cinder-quobyte-eae6fea5-a875-4cca-acd3-87ae2ba73f50" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-quobyte-eae6fea5-a875-4cca-acd3-87ae2ba73f50" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dfa2fa-e0ba-4479-8325-610cea0751b7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:19 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.708s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:01:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Deleted volume successfully. Jul 08 19:01:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ee0fe8b9-a0e7-4cdf-bc26-95b31e3edb99 tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-e3c465d1-6c2f-42ed-96f1-fe31d2ee7ca8-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:01:19 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 Jul 08 19:01:19 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:20 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:20 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50 Jul 08 19:01:20 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:21 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-eae6fea5-a875-4cca-acd3-87ae2ba73f50" returned: 0 in 0.662s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-quobyte-eae6fea5-a875-4cca-acd3-87ae2ba73f50" released by "delete_volume" :: held 1.455s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Created reservations ['444377d9-9c9c-419c-9ad3-4549518adb37', '3b86444b-2e82-4dc2-b602-85e6b81154ab', '70fc47d5-3d88-4679-8b0e-c8edba19ade5', 'a90ff416-997b-4f7d-8668-c161d4dda586'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:21 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:01:21 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:21 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.657s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:01:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Deleted volume successfully. Jul 08 19:01:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b4538da3-862b-4fe3-84d7-9371fb0da83c tempest-TestServerVolumeAttachmentScenario-2081703063 None] Lock "cinder-eae6fea5-a875-4cca-acd3-87ae2ba73f50-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:01:31 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=5 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:01:31 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Flow 'volume_create_manager' (64867428-75e9-437b-96f5-d3dd650c08be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf3a998-273b-466b-99ba-dfb7a406acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf3a998-273b-466b-99ba-dfb7a406acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1867421653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf622f8-83ef-4b65-a6d7-5964e1bd8fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23d314daa54401ca1d076348af4ba81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:01:54Z,use_quota=True,user_id='d46e151f89764c5bb12a4fb19591bdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed8fdaf-ef6a-4449-93ea-708fb3f37f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed8fdaf-ef6a-4449-93ea-708fb3f37f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aaafa2-3a41-43b4-aaf6-1dd05848af19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:01:53 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1aaafa2-3a41-43b4-aaf6-1dd05848af19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'volume_name': 'volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9c406a-8382-49e5-b46b-c6fe9df1b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9c406a-8382-49e5-b46b-c6fe9df1b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b597b-717c-4582-b92a-6b2626eab3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:01:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Trying to clone fcf622f8-83ef-4b65-a6d7-5964e1bd8fea from image dd434acf-5aa9-44c3-8328-d41e2c476c9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 19:01:54 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Image download 20.69 MB at 20.69 MB/s Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770bc46-8dec-4022-9612-533c547cfe00]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:54 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD Jul 08 19:01:54 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:55 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:55 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a is fetched for user d46e151f89764c5bb12a4fb19591bdbb. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 19:01:55 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f7a986-e731-492e-836c-7188a7f11791]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:55 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD Jul 08 19:01:55 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:56 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1867421653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf622f8-83ef-4b65-a6d7-5964e1bd8fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23d314daa54401ca1d076348af4ba81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:01:54Z,use_quota=True,user_id='d46e151f89764c5bb12a4fb19591bdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Creating volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:01:56 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:56 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1073741824 Jul 08 19:01:56 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:56 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1073741824" returned: 0 in 0.856s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:57 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:01:57 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:57 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Attempting download of dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d97d7-932a-4db9-9726-cef16953c627]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:57 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un Jul 08 19:01:57 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:58 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:58 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un Jul 08 19:01:58 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:01:59 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 08 19:01:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un" returned: 1 in 0.754s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:01:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd434acf-5aa9-44c3-8328-d41e2c476c9a_nawym2un' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:01:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9191f1-561a-44b0-b0bf-d918a79b0472]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:01:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:01:59 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD Jul 08 19:01:59 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:00 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:00 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] dd434acf-5aa9-44c3-8328-d41e2c476c9a was qcow2, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 19:02:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:00 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:00 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:01 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 1.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:01 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd434acf-5aa9-44c3-8328-d41e2c476c9a_vwmb3yfgdevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:02:01 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Converted 112.00 MB image at 62.27 MB/s Jul 08 19:02:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:01 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1G Jul 08 19:02:01 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:02 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea 1G" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43abfb-d190-470f-92ec-52c9c2d25b8f]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:02:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:02 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:02 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:03 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.750s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:03 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:03 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:04 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 1 in 0.753s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Downloaded image dd434acf-5aa9-44c3-8328-d41e2c476c9a ((None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}])) to volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Temporary image dd434acf-5aa9-44c3-8328-d41e2c476c9a for user d46e151f89764c5bb12a4fb19591bdbb is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Marking volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Copying metadata from image dd434acf-5aa9-44c3-8328-d41e2c476c9a to fcf622f8-83ef-4b65-a6d7-5964e1bd8fea. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Creating volume glance metadata for volume fcf622f8-83ef-4b65-a6d7-5964e1bd8fea backed by image dd434acf-5aa9-44c3-8328-d41e2c476c9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b597b-717c-4582-b92a-6b2626eab3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'volume_size': 1, 'image_id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5b4f4ad228247cca92b74d6f21bf198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd434acf-5aa9-44c3-8328-d41e2c476c9a', 'created_at': datetime.datetime(2026, 7, 8, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd434acf-5aa9-44c3-8328-d41e2c476c9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404d3c42-64ce-4883-b859-9c1aa9cf0d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:02:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Volume volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea (fcf622f8-83ef-4b65-a6d7-5964e1bd8fea): created successfully Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404d3c42-64ce-4883-b859-9c1aa9cf0d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:02:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Flow 'volume_create_manager' (64867428-75e9-437b-96f5-d3dd650c08be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:02:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4efb312c-4b6a-44ce-8b6a-eb7b2f8521e3 tempest-TestShelveInstance-921874462 None] Created volume successfully. Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ae719-a5f9-47cf-823a-12f15c27a476]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:13 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:13 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:13 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.864s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:14 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:14 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:14 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 1 in 0.759s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:02:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.661s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:02:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fef77e9-4ce3-4269-b1ff-4cef3b94ae80', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 19:02:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-a2368ddc-857d-493f-b42b-cd5d3eca18d6 req-f857bfa4-a8f4-4e16-bbf3-0e0caf31435b tempest-TestShelveInstance-921874462 None] attachment_update completed successfully. Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:18 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:02:18 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:18 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.749s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:02:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:02:24 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:02:24 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:02:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:02:42 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:02:50 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-e0e398de-7140-4fa4-ae34-30e71f707142 req-a0b4ad07-0d8a-46c7-8463-28bec413fda1 tempest-TestShelveInstance-921874462 None] Terminate volume connection completed successfully. Jul 08 19:02:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-e0e398de-7140-4fa4-ae34-30e71f707142 req-a0b4ad07-0d8a-46c7-8463-28bec413fda1 tempest-TestShelveInstance-921874462 None] Deleting attachment 3fef77e9-4ce3-4269-b1ff-4cef3b94ae80. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 19:02:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:02:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:02:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9d9af4-112d-4d00-bc93-3606b20b0e22]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:02:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:56 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:56 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:56 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:02:56 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:02:56 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:02:57 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 08 19:02:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 1 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:02:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:02:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.590s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:02:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf', 'name': 'volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29dce703-2840-4aaa-8d04-358d6f0219c4', 'enforce_multipath': True} {{(pid=87229) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 19:02:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-11c2ac3e-6add-4c2c-ac24-a015a2d4bfc7 req-1fe2fd36-dcae-4c16-a866-21d482ba1b77 tempest-TestShelveInstance-921874462 None] attachment_update completed successfully. Jul 08 19:03:07 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=7 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:03:07 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:18 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:03:18 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:18 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.672s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:03:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:03:37 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-140b6c71-71f8-49db-9d77-f08aca454cc2 tempest-TestShelveInstance-921874462 None] Terminate volume connection completed successfully. Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-140b6c71-71f8-49db-9d77-f08aca454cc2 tempest-TestShelveInstance-921874462 None] Deleting attachment 29dce703-2840-4aaa-8d04-358d6f0219c4. {{(pid=87229) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Acquiring lock "cinder-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "cinder-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Acquiring lock "cinder-quobyte-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "cinder-quobyte-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65379784-3011-431a-97ab-732ec08f2d61]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:03:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:38 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:03:38 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:38 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:38 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:03:38 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:39 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 1 in 0.777s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:03:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:39 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea Jul 08 19:03:39 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:40 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" returned: 0 in 0.674s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "cinder-quobyte-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea" released by "delete_volume" :: held 2.308s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG cinder.quota [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Created reservations ['09650d8f-3939-4a3a-a6df-b359917f7353', '616fd38d-4890-4290-a01f-4efd30f92daf', '1aa302d8-d000-4e1a-952b-fc6fa931b641', 'e9f78777-b772-475e-8964-9a07e362b45d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:40 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:03:40 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:40 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.704s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:40 devstack cinder-volume[87229]: DEBUG cinder.manager [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:03:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Deleted volume successfully. Jul 08 19:03:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [req-58a52e23-1150-40b5-bf2e-fda6255538ea req-09f2e975-d513-444f-b3f2-ee83d15f7972 tempest-TestShelveInstance-921874462 None] Lock "cinder-fcf622f8-83ef-4b65-a6d7-5964e1bd8fea-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (fa5908c2-57da-400d-a9ee-67e69cca1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bd98ad-94a8-4b33-a30b-c2052a679704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bd98ad-94a8-4b33-a30b-c2052a679704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-538286610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d343ac10-a103-49ac-b34d-fb0d830e957a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:50Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc40e6-afe3-477c-83d0-9d5c7981ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc40e6-afe3-477c-83d0-9d5c7981ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab3962-a69b-4d14-b903-b18dd5dfd037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab3962-a69b-4d14-b903-b18dd5dfd037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd343ac10-a103-49ac-b34d-fb0d830e957a', 'volume_name': 'volume-d343ac10-a103-49ac-b34d-fb0d830e957a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840a7834-ebae-4166-b069-8e8836f8d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840a7834-ebae-4166-b069-8e8836f8d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a471fd-da44-41fc-81f8-b701d801dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Volume d343ac10-a103-49ac-b34d-fb0d830e957a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d343ac10-a103-49ac-b34d-fb0d830e957a', 'volume_size': 1} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-538286610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d343ac10-a103-49ac-b34d-fb0d830e957a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:50Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Creating volume d343ac10-a103-49ac-b34d-fb0d830e957a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:03:50 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:50 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a 1073741824 Jul 08 19:03:50 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (2fc18628-916f-4052-bb90-4f0b535752a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00f5636-efde-4c92-82ff-3ef524887d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00f5636-efde-4c92-82ff-3ef524887d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823776874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25905660-1540-435d-aacb-f6f63e6b7db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:51Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fd8be9-0878-43fa-ab02-1d5158dc95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42fd8be9-0878-43fa-ab02-1d5158dc95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3f0d60-2572-4d06-8c2d-c3deb75a28b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3f0d60-2572-4d06-8c2d-c3deb75a28b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25905660-1540-435d-aacb-f6f63e6b7db3', 'volume_name': 'volume-25905660-1540-435d-aacb-f6f63e6b7db3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae770983-d9e2-4304-8a11-172e94f2ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae770983-d9e2-4304-8a11-172e94f2ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0202644d-7b6a-42c2-8753-16b2ef787709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:50 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Volume 25905660-1540-435d-aacb-f6f63e6b7db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25905660-1540-435d-aacb-f6f63e6b7db3', 'volume_size': 1} Jul 08 19:03:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (5a31537d-c6eb-466d-8cd1-a2f522facf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17686ce9-991c-4de9-9f70-ecab22fe5ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17686ce9-991c-4de9-9f70-ecab22fe5ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883288056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b5c0c0-b5f0-4305-b681-243c60dbe435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:51Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c9ccf-435c-4a1c-a029-8c391365e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c9ccf-435c-4a1c-a029-8c391365e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b330b06-f1ca-4010-8193-e94238d906ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b330b06-f1ca-4010-8193-e94238d906ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b5c0c0-b5f0-4305-b681-243c60dbe435', 'volume_name': 'volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63d365c-1b58-49ff-9487-08289cbf4274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63d365c-1b58-49ff-9487-08289cbf4274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365a8553-6c37-4d76-9e8b-7b7c35fd247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Volume b2b5c0c0-b5f0-4305-b681-243c60dbe435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435', 'volume_size': 1} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:51 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a 1073741824" returned: 0 in 0.930s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:51 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a Jul 08 19:03:51 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (6d993810-9de8-49ba-9f65-19f25d2865f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb532298-1f68-49e8-b788-90390477b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb532298-1f68-49e8-b788-90390477b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959480573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9323d9-201c-42d8-bfa8-43735733713a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:52Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5437c0ac-cfa0-4d65-9480-4cedca11e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5437c0ac-cfa0-4d65-9480-4cedca11e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abc174a-bde0-4572-94d4-42c4f9316f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abc174a-bde0-4572-94d4-42c4f9316f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9323d9-201c-42d8-bfa8-43735733713a', 'volume_name': 'volume-6f9323d9-201c-42d8-bfa8-43735733713a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9fe71d-a87b-486e-bc18-f60916677f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9fe71d-a87b-486e-bc18-f60916677f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04a5326-d7ca-495f-b74a-40ea57298312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Volume 6f9323d9-201c-42d8-bfa8-43735733713a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9323d9-201c-42d8-bfa8-43735733713a', 'volume_size': 1} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:03:52 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (03a103f3-3842-4647-bade-4725d57939f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680cbfc5-f8bc-47b8-9502-6823b8b837e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a" returned: 0 in 0.796s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823776874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25905660-1540-435d-aacb-f6f63e6b7db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:51Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Creating volume 25905660-1540-435d-aacb-f6f63e6b7db3 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:03:52 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680cbfc5-f8bc-47b8-9502-6823b8b837e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001793410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4df30ea-2ed7-4a67-9db2-bcb8780ac860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:52Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 1073741824 Jul 08 19:03:52 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55550a2-6261-4744-b1c3-34917b3638ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55550a2-6261-4744-b1c3-34917b3638ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d59757-c6a9-4868-a1b2-68c6c0fa431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d59757-c6a9-4868-a1b2-68c6c0fa431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4df30ea-2ed7-4a67-9db2-bcb8780ac860', 'volume_name': 'volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ae2858-4082-4d4d-af7c-889512047e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ae2858-4082-4d4d-af7c-889512047e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5bdc64-949f-4d98-9d08-8b128afea17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Volume e4df30ea-2ed7-4a67-9db2-bcb8780ac860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860', 'volume_size': 1} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a471fd-da44-41fc-81f8-b701d801dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d343ac10-a103-49ac-b34d-fb0d830e957a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580f6ef9-aea0-472b-b2c2-fd136c8f2fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Volume volume-d343ac10-a103-49ac-b34d-fb0d830e957a (d343ac10-a103-49ac-b34d-fb0d830e957a): created successfully Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580f6ef9-aea0-472b-b2c2-fd136c8f2fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (fa5908c2-57da-400d-a9ee-67e69cca1682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bb17cce4-a337-4557-b393-bd1134cd7c8c tempest-CreateVolumesFromImageTest-1856919127 None] Created volume successfully. Jul 08 19:03:53 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 1073741824" returned: 0 in 0.817s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:53 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 Jul 08 19:03:53 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:53 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.487s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883288056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b5c0c0-b5f0-4305-b681-243c60dbe435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:51Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Creating volume b2b5c0c0-b5f0-4305-b681-243c60dbe435 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:03:53 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0202644d-7b6a-42c2-8753-16b2ef787709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25905660-1540-435d-aacb-f6f63e6b7db3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:53 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 1073741824 Jul 08 19:03:53 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ed2b7-2391-437a-8e50-96285fc7b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:53 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Volume volume-25905660-1540-435d-aacb-f6f63e6b7db3 (25905660-1540-435d-aacb-f6f63e6b7db3): created successfully Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ed2b7-2391-437a-8e50-96285fc7b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (2fc18628-916f-4052-bb90-4f0b535752a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5e372506-50e0-48c9-ab63-0d9f656325fb tempest-CreateVolumesFromImageTest-1856919127 None] Created volume successfully. Jul 08 19:03:54 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 1073741824" returned: 0 in 0.862s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:54 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 Jul 08 19:03:54 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:55 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.421s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959480573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9323d9-201c-42d8-bfa8-43735733713a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:52Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Creating volume 6f9323d9-201c-42d8-bfa8-43735733713a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:03:55 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365a8553-6c37-4d76-9e8b-7b7c35fd247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:55 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a 1073741824 Jul 08 19:03:55 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a9b763-8acf-4d54-92f6-33672e31a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Volume volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 (b2b5c0c0-b5f0-4305-b681-243c60dbe435): created successfully Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a9b763-8acf-4d54-92f6-33672e31a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (5a31537d-c6eb-466d-8cd1-a2f522facf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-195fb0bc-2c91-484e-b4dc-9645411b5ddd tempest-CreateVolumesFromImageTest-1856919127 None] Created volume successfully. Jul 08 19:03:56 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a 1073741824" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:56 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a Jul 08 19:03:56 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:56 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a" returned: 0 in 0.659s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.554s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001793410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4df30ea-2ed7-4a67-9db2-bcb8780ac860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f68d42c018b46b6b5aba3e2aeb06022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:03:52Z,use_quota=True,user_id='e95bc6eef61e4947b0a97878725a7666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Creating volume e4df30ea-2ed7-4a67-9db2-bcb8780ac860 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:03:56 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:03:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:57 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 1073741824 Jul 08 19:03:57 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04a5326-d7ca-495f-b74a-40ea57298312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9323d9-201c-42d8-bfa8-43735733713a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6e74b2-357d-458e-8455-e2a9622fb975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Volume volume-6f9323d9-201c-42d8-bfa8-43735733713a (6f9323d9-201c-42d8-bfa8-43735733713a): created successfully Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6e74b2-357d-458e-8455-e2a9622fb975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (6d993810-9de8-49ba-9f65-19f25d2865f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1c2c891b-2b70-40dc-8c2c-a291f7fd7fec tempest-CreateVolumesFromImageTest-1856919127 None] Created volume successfully. Jul 08 19:03:57 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 1073741824" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:57 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 Jul 08 19:03:57 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:58 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" returned: 0 in 0.639s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5bdc64-949f-4d98-9d08-8b128afea17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69347f7f-3692-47b7-86eb-36f7cb5546de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:03:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Volume volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 (e4df30ea-2ed7-4a67-9db2-bcb8780ac860): created successfully Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69347f7f-3692-47b7-86eb-36f7cb5546de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Flow 'volume_create_manager' (03a103f3-3842-4647-bade-4725d57939f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:03:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-93b14782-4df5-4ccf-9d2d-c10bcb0467b4 tempest-CreateVolumesFromImageTest-1856919127 None] Created volume successfully. Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-e4df30ea-2ed7-4a67-9db2-bcb8780ac860-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-e4df30ea-2ed7-4a67-9db2-bcb8780ac860-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-quobyte-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" acquired by "delete_volume" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c81f25-9724-40f9-a745-7c65ef5e81d3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:03:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:59 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 Jul 08 19:03:59 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:03:59 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 08 19:03:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:03:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:03:59 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860 Jul 08 19:03:59 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:00 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" returned: 0 in 0.672s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-e4df30ea-2ed7-4a67-9db2-bcb8780ac860" released by "delete_volume" :: held 1.491s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Created reservations ['732c2163-8869-4bcd-8d3c-a816a3f419c5', '376daa74-ee7e-494d-99d8-613f91fcbc33', '5198bb3d-dbc9-43ca-b5c7-120b4775ed53', '03da3be9-ef65-401a-8638-b551ec711897'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:00 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:00 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-6f9323d9-201c-42d8-bfa8-43735733713a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-6f9323d9-201c-42d8-bfa8-43735733713a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-quobyte-6f9323d9-201c-42d8-bfa8-43735733713a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:01 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-6f9323d9-201c-42d8-bfa8-43735733713a" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Deleted volume successfully. Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebf9d48-407c-4968-ac1f-c5a182176d59]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3c020e6b-1cdd-4ea6-aca0-065483e576bd tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-e4df30ea-2ed7-4a67-9db2-bcb8780ac860-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:01 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a Jul 08 19:04:01 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:01 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a" returned: 0 in 0.762s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:01 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a Jul 08 19:04:01 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:02 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6f9323d9-201c-42d8-bfa8-43735733713a" returned: 0 in 0.629s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-6f9323d9-201c-42d8-bfa8-43735733713a" released by "delete_volume" :: held 1.435s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Created reservations ['209f43d1-44d5-446a-a7e9-89406cabe9b8', '33e7849f-3d33-4d5c-b25a-9d430c2619bd', '4b79db43-48f4-4020-97ba-49ef43716eb9', 'f73f6c42-240f-4950-9f97-edb732467f1e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:02 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:02 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-b2b5c0c0-b5f0-4305-b681-243c60dbe435-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-b2b5c0c0-b5f0-4305-b681-243c60dbe435-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-quobyte-b2b5c0c0-b5f0-4305-b681-243c60dbe435" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:03 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Deleted volume successfully. Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-b2b5c0c0-b5f0-4305-b681-243c60dbe435" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-06229bf1-8a30-45c5-9d13-528bc7730ba3 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-6f9323d9-201c-42d8-bfa8-43735733713a-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0036d51a-6d34-4a6c-8247-bf6bf6800690]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:03 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 Jul 08 19:04:03 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:04 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:04 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435 Jul 08 19:04:04 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:04 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b2b5c0c0-b5f0-4305-b681-243c60dbe435" returned: 0 in 0.632s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-b2b5c0c0-b5f0-4305-b681-243c60dbe435" released by "delete_volume" :: held 1.438s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Created reservations ['d11638d3-58cf-4e2c-84dc-afd186f03d19', '8f1da6ff-c802-463a-8569-087835c5c64c', 'e19d25f1-a2b9-4cd4-89d5-2a7e31c3ef6a', '845b6876-fd6f-42bb-b627-473b00724ec0'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:04 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:04 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-25905660-1540-435d-aacb-f6f63e6b7db3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-25905660-1540-435d-aacb-f6f63e6b7db3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-quobyte-25905660-1540-435d-aacb-f6f63e6b7db3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:05 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-25905660-1540-435d-aacb-f6f63e6b7db3" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Deleted volume successfully. Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeecb84-932a-4e73-a740-079478e0aa02]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ff71d16-906f-4be7-b63b-6966c5ea9e24 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-b2b5c0c0-b5f0-4305-b681-243c60dbe435-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:05 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 Jul 08 19:04:05 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:06 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3" returned: 0 in 0.736s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:06 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3 Jul 08 19:04:06 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:07 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-25905660-1540-435d-aacb-f6f63e6b7db3" returned: 0 in 0.631s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-25905660-1540-435d-aacb-f6f63e6b7db3" released by "delete_volume" :: held 1.411s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Created reservations ['588998a8-6e5a-4273-84ce-0b4784cc77cd', '31cd461a-bdd5-4a47-9ba5-75349e392f72', '52763241-0dce-4df2-b953-ca8352361caa', '1284844e-a3a0-41b1-9737-b80b8fa9d498'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:07 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:07 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:07 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-d343ac10-a103-49ac-b34d-fb0d830e957a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Deleted volume successfully. Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-d343ac10-a103-49ac-b34d-fb0d830e957a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e224e502-40be-44d1-9bbd-5108dab57cca tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-25905660-1540-435d-aacb-f6f63e6b7db3-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "cinder-quobyte-d343ac10-a103-49ac-b34d-fb0d830e957a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-d343ac10-a103-49ac-b34d-fb0d830e957a" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[986aa52f-09e4-4090-8e64-ce829edcb838]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:07 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a Jul 08 19:04:07 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:08 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a" returned: 0 in 0.737s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:08 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a Jul 08 19:04:08 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:09 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d343ac10-a103-49ac-b34d-fb0d830e957a" returned: 0 in 0.631s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-quobyte-d343ac10-a103-49ac-b34d-fb0d830e957a" released by "delete_volume" :: held 1.405s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Created reservations ['64c6653f-1e07-49b5-a323-5808c3f6083f', '6b533a0f-9e7b-4fa1-b2fd-f4cc4a6ada43', 'a1601192-a519-4582-8fec-f7c71b03e983', 'b9704a33-47b4-4aad-9af3-6f27d849fdcf'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:09 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:09 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:10 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.645s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:10 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Deleted volume successfully. Jul 08 19:04:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b659a88-c30d-4a0f-ae36-6ace0683aab6 tempest-CreateVolumesFromImageTest-1856919127 None] Lock "cinder-d343ac10-a103-49ac-b34d-fb0d830e957a-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (054b8999-1b85-46cc-b64b-6766bd604822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f839f684-6741-4824-aa24-12d8912f4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f839f684-6741-4824-aa24-12d8912f4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989169355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c7795-5bd2-4fc9-bc7b-5711c50d24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:13Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab04ee3-e580-427e-ae9a-86b4597b36b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab04ee3-e580-427e-ae9a-86b4597b36b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676fff43-e32c-4f0a-8acb-3b9d8970f99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676fff43-e32c-4f0a-8acb-3b9d8970f99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901c7795-5bd2-4fc9-bc7b-5711c50d24c3', 'volume_name': 'volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9225d837-d9d4-40d3-80be-148fb8c9b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9225d837-d9d4-40d3-80be-148fb8c9b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e628cd-9ede-4cc2-9ee6-a7b0a37058ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume 901c7795-5bd2-4fc9-bc7b-5711c50d24c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3', 'volume_size': 1} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989169355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c7795-5bd2-4fc9-bc7b-5711c50d24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:13Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume 901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:12 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:12 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 1073741824 Jul 08 19:04:12 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:13 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 1073741824" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:13 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 Jul 08 19:04:13 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:14 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" returned: 0 in 0.670s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e628cd-9ede-4cc2-9ee6-a7b0a37058ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f967b081-621a-4bab-b56b-2b8090356945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 (901c7795-5bd2-4fc9-bc7b-5711c50d24c3): created successfully Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f967b081-621a-4bab-b56b-2b8090356945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (054b8999-1b85-46cc-b64b-6766bd604822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dcc957ec-0268-452c-85e0-5132c3f8bc94 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating offline snapshot c46393eb-e091-40d9-826a-2173f4c92e57 of volume 901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f710885-ab01-4c21-8d75-8f9cebca1552]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:15 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 Jul 08 19:04:15 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:15 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:15 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 1G Jul 08 19:04:15 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:16 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 1G" returned: 0 in 0.783s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:16 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 Jul 08 19:04:16 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:17 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57" returned: 0 in 0.698s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:17 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 is being set with open permissions: ugo+rw Jul 08 19:04:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:17 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 Jul 08 19:04:17 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:17 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:18 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info Jul 08 19:04:18 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:18 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:18 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:18 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info" returned: 0 in 0.663s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:18 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info is being set with open permissions: ugo+rw Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:18 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info Jul 08 19:04:18 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:18 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.655s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:04:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:04:19 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.info" returned: 0 in 0.665s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.293s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c3c1b91e-a32e-4557-b6bf-5647598ae1e8 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Create snapshot completed successfully Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (e381fc68-06f9-4a45-a20f-a5a7cb7ee854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb4d1e6-8bac-4162-be7b-6a53dc572aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb4d1e6-8bac-4162-be7b-6a53dc572aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70791325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf8b0e2-a107-4d3e-b902-c10294cb2127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5a37d-6ba4-481b-8a1c-0fd0941d050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5a37d-6ba4-481b-8a1c-0fd0941d050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7c2643-a4ee-4a76-9d0a-22e2761c42b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7c2643-a4ee-4a76-9d0a-22e2761c42b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf8b0e2-a107-4d3e-b902-c10294cb2127', 'volume_name': 'volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a91ca3-d7a6-4d97-8d25-28b6734b9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a91ca3-d7a6-4d97-8d25-28b6734b9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0e7fc8-b0bd-4f95-8988-9ff33ec2f3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:20 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume fbf8b0e2-a107-4d3e-b902-c10294cb2127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127', 'volume_size': 1} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70791325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf8b0e2-a107-4d3e-b902-c10294cb2127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume fbf8b0e2-a107-4d3e-b902-c10294cb2127 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:20 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:20 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 1073741824 Jul 08 19:04:20 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (ad3ff341-4977-4115-a0a5-c5ba3cee4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bab4d5c-4849-4af7-a6ad-df3cc010e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bab4d5c-4849-4af7-a6ad-df3cc010e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781176311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab28a7f-dbbc-434c-90dd-bac547d28d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843b9008-4128-4874-bc89-3a52a308fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843b9008-4128-4874-bc89-3a52a308fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d917ef43-6c8a-4ea2-9184-0ba3e87e57b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d917ef43-6c8a-4ea2-9184-0ba3e87e57b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab28a7f-dbbc-434c-90dd-bac547d28d79', 'volume_name': 'volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84baec52-cb46-4bdd-b2b5-b481ecb810da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84baec52-cb46-4bdd-b2b5-b481ecb810da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd540877-c457-4de3-9868-c292f631670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume 7ab28a7f-dbbc-434c-90dd-bac547d28d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79', 'volume_size': 1} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (a50f3faa-db89-4183-9195-be7f1e416f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ac256c-e453-486e-9940-2ed18583602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ac256c-e453-486e-9940-2ed18583602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786153407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d21a67-b398-46ea-a2f8-47361e87e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d21a67-b398-46ea-a2f8-47361e87e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8053647b-8641-4b3d-8e3a-efa04562bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8053647b-8641-4b3d-8e3a-efa04562bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46', 'volume_name': 'volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c609e331-8520-4047-82b0-6d699158b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c609e331-8520-4047-82b0-6d699158b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0ef926-d3b4-43cc-b49d-07c0b77ee2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume 9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46', 'volume_size': 1} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:21 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 1073741824" returned: 0 in 0.974s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (c0945aa4-f618-4021-9f4c-7f9c31b9e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a2f35-bfeb-4757-9d08-7145b2ec9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a2f35-bfeb-4757-9d08-7145b2ec9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911194284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:22Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d943782c-0358-498b-814d-eb9d1071bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d943782c-0358-498b-814d-eb9d1071bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0250f7-5a27-4d48-9390-b3841b99c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0250f7-5a27-4d48-9390-b3841b99c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485', 'volume_name': 'volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb3cb08-67f9-4a3a-ad6f-57c42cfe3549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb3cb08-67f9-4a3a-ad6f-57c42cfe3549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f9872b-c32c-49e2-a461-b26df26a13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume 3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485', 'volume_size': 1} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:21 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 Jul 08 19:04:21 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (cfa9d4d7-ddc8-4914-9fce-722e4debfee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e47c28-4d24-4d94-8a0c-344b5d8e74ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e47c28-4d24-4d94-8a0c-344b5d8e74ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277511726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe33a5e-5d39-44f2-886d-3834d7dace6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:22Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8b5e65-96b7-4616-be2e-d5b89354bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8b5e65-96b7-4616-be2e-d5b89354bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719bfb14-d85b-483a-9368-13eabda674c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719bfb14-d85b-483a-9368-13eabda674c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe33a5e-5d39-44f2-886d-3834d7dace6a', 'volume_name': 'volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a10bc2-043a-44ea-aabe-a283730356e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a10bc2-043a-44ea-aabe-a283730356e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9608ad94-4ee6-4456-8149-33cb8c5fa8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume dbe33a5e-5d39-44f2-886d-3834d7dace6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a', 'volume_size': 1} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:22 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781176311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab28a7f-dbbc-434c-90dd-bac547d28d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume 7ab28a7f-dbbc-434c-90dd-bac547d28d79 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:22 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:22 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 1073741824 Jul 08 19:04:22 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0e7fc8-b0bd-4f95-8988-9ff33ec2f3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e642c04-1410-4470-a7d9-6829bff1b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 (fbf8b0e2-a107-4d3e-b902-c10294cb2127): created successfully Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e642c04-1410-4470-a7d9-6829bff1b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (e381fc68-06f9-4a45-a20f-a5a7cb7ee854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-161f7520-565a-42ad-a342-fa2cdce6ab86 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:23 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 1073741824" returned: 0 in 0.824s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:23 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 Jul 08 19:04:23 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:24 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79" returned: 0 in 0.661s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.548s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786153407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:21Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume 9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:24 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:24 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 1073741824 Jul 08 19:04:24 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd540877-c457-4de3-9868-c292f631670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55da7c5-7138-4502-bae2-caa82bce4e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 (7ab28a7f-dbbc-434c-90dd-bac547d28d79): created successfully Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55da7c5-7138-4502-bae2-caa82bce4e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (ad3ff341-4977-4115-a0a5-c5ba3cee4657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-de4d211d-1f9c-431e-a67e-c437b0a7f18f tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:24 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 1073741824" returned: 0 in 0.817s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:24 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 Jul 08 19:04:24 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:25 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" returned: 0 in 0.647s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.726s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911194284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:22Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume 3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:25 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:25 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 1073741824 Jul 08 19:04:25 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0ef926-d3b4-43cc-b49d-07c0b77ee2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5444fe-1b05-45e7-b58e-6984a8244728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 (9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46): created successfully Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5444fe-1b05-45e7-b58e-6984a8244728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (a50f3faa-db89-4183-9195-be7f1e416f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8f257698-c965-45e6-b34f-f099d97f5ff3 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:26 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 1073741824" returned: 0 in 0.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:26 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 Jul 08 19:04:26 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:27 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.937s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277511726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe33a5e-5d39-44f2-886d-3834d7dace6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244614cd5bc4f22ae72427a32219be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:22Z,use_quota=True,user_id='1fdc735a260f4b249c1e124c66ac4d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Creating volume dbe33a5e-5d39-44f2-886d-3834d7dace6a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:27 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:27 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a 1073741824 Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f9872b-c32c-49e2-a461-b26df26a13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:27 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408ee323-5c13-48d4-95d1-c1257ff3227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:27 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 (3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485): created successfully Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408ee323-5c13-48d4-95d1-c1257ff3227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (c0945aa4-f618-4021-9f4c-7f9c31b9e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b89cf0d6-8e48-4827-a509-f12750671e2d tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:27 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a 1073741824" returned: 0 in 0.829s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:27 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=58,cinder:INSERT=17,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:28 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a Jul 08 19:04:28 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:28 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a" returned: 0 in 0.670s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9608ad94-4ee6-4456-8149-33cb8c5fa8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d043cc-37ec-4394-be8a-c799961bf15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:28 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Volume volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a (dbe33a5e-5d39-44f2-886d-3834d7dace6a): created successfully Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d043cc-37ec-4394-be8a-c799961bf15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:28 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Flow 'volume_create_manager' (cfa9d4d7-ddc8-4914-9fce-722e4debfee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-75188bc9-b01b-49b5-a2dc-60f98ac99531 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created volume successfully. Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-dbe33a5e-5d39-44f2-886d-3834d7dace6a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-dbe33a5e-5d39-44f2-886d-3834d7dace6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-dbe33a5e-5d39-44f2-886d-3834d7dace6a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-dbe33a5e-5d39-44f2-886d-3834d7dace6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43329c58-f1c6-4ef8-88b5-b174d7047de2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:29 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a Jul 08 19:04:29 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:30 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:30 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a Jul 08 19:04:30 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:31 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dbe33a5e-5d39-44f2-886d-3834d7dace6a" returned: 0 in 0.651s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-dbe33a5e-5d39-44f2-886d-3834d7dace6a" released by "delete_volume" :: held 1.453s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['84b91576-833b-4a68-9c86-49b3bb7f2394', '051a038b-b50d-42cd-afcd-1d5f188566ee', '9d2cfa8f-a460-45e0-a108-1e7e0a16e3e2', 'b51124c1-1ee3-4841-ad9c-ca4b0ad49f44'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:31 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:31 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:32 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.680s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa3ae4-6bae-4369-8fb0-a5b944dc7f0c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-601865e1-f6ad-40d1-aedf-f8683dc04896 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-dbe33a5e-5d39-44f2-886d-3834d7dace6a-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:32 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 Jul 08 19:04:32 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:32 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:32 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485 Jul 08 19:04:32 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:33 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" returned: 0 in 0.651s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485" released by "delete_volume" :: held 1.490s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['f7b4396d-06e7-43fb-9a27-b92a8da0b6df', '83143ebf-9fb1-479f-8e74-8e110b4550b7', 'd70ce1ab-c3da-4e1b-8609-b6cd27de0431', 'b39b1976-cfd7-4a44-a2f6-03380282b23e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:33 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:33 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff9461-2f78-4ff8-aa5e-1ddbadd7a847]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:34 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.687s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6cc6d7ed-f70d-46db-8fd0-1d3c2d738067 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-3c49b67e-b9ee-4510-a6b2-a6e8bdb9d485-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:34 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 Jul 08 19:04:34 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:35 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:35 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46 Jul 08 19:04:35 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:35 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" returned: 0 in 0.648s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46" released by "delete_volume" :: held 1.450s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['a2360599-cc8a-4f27-9528-dfa1718ec4e4', '032f936d-7711-41cb-acd7-8b1e6c1ad040', '3ac641c2-c526-4ea3-a5da-ffe196531bb7', 'c7171aa1-13f5-477c-936b-9be647331044'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:35 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:35 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-7ab28a7f-dbbc-434c-90dd-bac547d28d79-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-7ab28a7f-dbbc-434c-90dd-bac547d28d79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:36 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.663s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-7ab28a7f-dbbc-434c-90dd-bac547d28d79" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-7ab28a7f-dbbc-434c-90dd-bac547d28d79" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6aaee651-b441-4648-86da-ad76d5b64301 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-9bd8341f-f34d-4dbd-95c4-68ab9ffbfb46-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89a3605-7990-4a9c-9c4b-7e4d106352e2]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:36 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 Jul 08 19:04:36 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:37 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:37 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79 Jul 08 19:04:37 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:37 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-7ab28a7f-dbbc-434c-90dd-bac547d28d79" returned: 0 in 0.657s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-7ab28a7f-dbbc-434c-90dd-bac547d28d79" released by "delete_volume" :: held 1.457s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['149a2b31-677a-4e7c-8586-72412b74e787', 'd3c10a6f-4e73-4c2b-bbd2-667b4786054d', 'be92e6a3-b933-4fd9-9f73-d9d8128b2e30', '4930d264-1f15-4aa5-92bb-9844534e16bc'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:38 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:38 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-fbf8b0e2-a107-4d3e-b902-c10294cb2127-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-fbf8b0e2-a107-4d3e-b902-c10294cb2127-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:38 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.668s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-fbf8b0e2-a107-4d3e-b902-c10294cb2127" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1c05bc35-9617-412f-af02-c41a069df466 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-7ab28a7f-dbbc-434c-90dd-bac547d28d79-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-fbf8b0e2-a107-4d3e-b902-c10294cb2127" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[978789fd-e55e-40da-ae86-5f0d96cd67ea]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:38 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 Jul 08 19:04:38 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:39 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:39 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127 Jul 08 19:04:39 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:40 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-fbf8b0e2-a107-4d3e-b902-c10294cb2127" returned: 0 in 0.640s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-fbf8b0e2-a107-4d3e-b902-c10294cb2127" released by "delete_volume" :: held 1.435s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['604ac650-e432-4539-9e78-a4a599a1d688', '1b9f92cc-73c9-4399-9104-30aec9c333a4', 'bb75189a-6abb-4e15-a74a-26c5a1d4b13a', 'bbf6846b-9e17-4f72-94ae-e5f479dfcbc3'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:40 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:40 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-c46393eb-e091-40d9-826a-2173f4c92e57-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-c46393eb-e091-40d9-826a-2173f4c92e57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-c46393eb-e091-40d9-826a-2173f4c92e57" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-c46393eb-e091-40d9-826a-2173f4c92e57" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleting offline snapshot c46393eb-e091-40d9-826a-2173f4c92e57 of volume 901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] snapshot_file for this snap is: volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a658a-51c0-4a31-a63e-c13947ba08da]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:41 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.671s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ff372519-1380-46a7-ab61-c33526f44ca1 tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-fbf8b0e2-a107-4d3e-b902-c10294cb2127-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:41 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 Jul 08 19:04:41 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:41 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57" returned: 0 in 0.802s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e981a-8f96-495f-8722-b1c83582dc7a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:41 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 Jul 08 19:04:41 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:42 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:42 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 Jul 08 19:04:42 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:43 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:43 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57 Jul 08 19:04:43 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:43 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3.c46393eb-e091-40d9-826a-2173f4c92e57" returned: 0 in 0.638s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-c46393eb-e091-40d9-826a-2173f4c92e57" released by "_delete_snapshot" :: held 3.056s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" released by "delete_snapshot" :: held 3.080s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:44 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['6b0ef25d-9837-49a2-be6a-eadb30777a3e', 'febe5cbd-5a01-48ae-8466-c13a4da4c0f7', '21b2147f-c5a9-4e96-a09f-60ad5f61ee33', 'e91bc801-086d-4127-b50b-818489f3a2d6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Delete snapshot completed successfully. Jul 08 19:04:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed1d047e-f60c-4e1c-8097-36481c67155e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-c46393eb-e091-40d9-826a-2173f4c92e57-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-901c7795-5bd2-4fc9-bc7b-5711c50d24c3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-901c7795-5bd2-4fc9-bc7b-5711c50d24c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d7c467-695f-4cca-96a4-64f801a82636]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:45 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 Jul 08 19:04:45 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:45 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" returned: 0 in 0.726s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:45 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3 Jul 08 19:04:45 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:46 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-quobyte-901c7795-5bd2-4fc9-bc7b-5711c50d24c3" released by "delete_volume" :: held 1.439s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Created reservations ['e48dbef7-180a-4ffb-bfa8-614da8415bb9', '64e31bf2-61ef-44a4-a36d-01cb49b78667', '10381b01-d713-438c-bec1-9cda9fa35b6b', '63482d4d-82cc-49de-bc90-289351421bfd'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:46 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:04:46 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:47 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.640s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:47 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:04:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Deleted volume successfully. Jul 08 19:04:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-93c6fd7b-dc87-4c68-b828-2e3bac6f745e tempest-CreateVolumesFromSnapshotTest-1093324452 None] Lock "cinder-901c7795-5bd2-4fc9-bc7b-5711c50d24c3-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:04:49 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Flow 'volume_create_manager' (2e831e81-f23c-41f1-b82e-cab3ccf369ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdd47e0-d52d-4d11-b2cc-7e06848974f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdd47e0-d52d-4d11-b2cc-7e06848974f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-338153632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e42d3e-bc79-46f0-9eb1-7687816618ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19021a675d4fa1850c1a8fdc1f1b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:50Z,use_quota=True,user_id='bb8ccde996f348b0b8f5209ddd0ed801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac690a25-00b6-446c-9028-4d4575a8aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac690a25-00b6-446c-9028-4d4575a8aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338a55c0-2c21-4f49-95f5-9a6170f946de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338a55c0-2c21-4f49-95f5-9a6170f946de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e42d3e-bc79-46f0-9eb1-7687816618ad', 'volume_name': 'volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db5595b-2b2b-4856-bf07-e4a6a8db8837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db5595b-2b2b-4856-bf07-e4a6a8db8837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3fa57f-f5ec-460a-b912-3f6681f16585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:50 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Volume a2e42d3e-bc79-46f0-9eb1-7687816618ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad', 'volume_size': 1} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-338153632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e42d3e-bc79-46f0-9eb1-7687816618ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19021a675d4fa1850c1a8fdc1f1b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:50Z,use_quota=True,user_id='bb8ccde996f348b0b8f5209ddd0ed801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Creating volume a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:50 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:50 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad 1073741824 Jul 08 19:04:50 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:50 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad 1073741824" returned: 0 in 0.825s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=89,cinder:UPDATE=122,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:04:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:50 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:04:50 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:51 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.658s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3fa57f-f5ec-460a-b912-3f6681f16585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f0d0bc-bb9d-492f-8b33-64704360635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Volume volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad (a2e42d3e-bc79-46f0-9eb1-7687816618ad): created successfully Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f0d0bc-bb9d-492f-8b33-64704360635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Flow 'volume_create_manager' (2e831e81-f23c-41f1-b82e-cab3ccf369ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-675b9368-0e7a-4a81-a749-badb94f9ef9d tempest-VolumeDependencyTests-2007064424 None] Created volume successfully. Jul 08 19:04:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Creating offline snapshot b0b576dc-3eef-4a85-9f0b-90bc3b6e178c of volume a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:04:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[24034076-c790-411a-b189-f8243a5c78fb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:52 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:04:52 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:53 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:53 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c 1G Jul 08 19:04:53 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:53 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c 1G" returned: 0 in 0.802s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:53 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:04:53 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:54 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:54 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c is being set with open permissions: ugo+rw Jul 08 19:04:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:54 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:04:54 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:55 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.623s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:55 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info Jul 08 19:04:55 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:55 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info" returned: 0 in 0.670s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:55 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info is being set with open permissions: ugo+rw Jul 08 19:04:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:55 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info Jul 08 19:04:55 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:56 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.info" returned: 0 in 0.627s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-06a17fbe-a66d-48b8-9f03-12aa983bc742 tempest-VolumeDependencyTests-2007064424 None] Create snapshot completed successfully Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Flow 'volume_create_manager' (904674a5-edbd-46c5-b5b9-f57500359725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81664cd-ebe4-40b8-9a33-0f7e65f7fc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81664cd-ebe4-40b8-9a33-0f7e65f7fc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-755383133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e8131c-445c-4bb1-938f-a6731e976166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f19021a675d4fa1850c1a8fdc1f1b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0b576dc-3eef-4a85-9f0b-90bc3b6e178c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:04:58Z,use_quota=True,user_id='bb8ccde996f348b0b8f5209ddd0ed801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7529510-cd87-43d4-af6d-f7d536f1a428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7529510-cd87-43d4-af6d-f7d536f1a428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb1cd7-a32c-4942-9ce6-060195f1a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb1cd7-a32c-4942-9ce6-060195f1a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31e8131c-445c-4bb1-938f-a6731e976166', 'volume_name': 'volume-31e8131c-445c-4bb1-938f-a6731e976166', 'volume_size': 1, 'snapshot_id': 'b0b576dc-3eef-4a85-9f0b-90bc3b6e178c'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d5013f-5335-49c4-af59-33c6f375e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d5013f-5335-49c4-af59-33c6f375e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf55d-df96-4c57-8a7d-755332d9138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:04:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Volume 31e8131c-445c-4bb1-938f-a6731e976166: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31e8131c-445c-4bb1-938f-a6731e976166', 'volume_size': 1, 'snapshot_id': 'b0b576dc-3eef-4a85-9f0b-90bc3b6e178c'} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-31e8131c-445c-4bb1-938f-a6731e976166" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-31e8131c-445c-4bb1-938f-a6731e976166" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Creating volume 31e8131c-445c-4bb1-938f-a6731e976166 from snapshot b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] snapshot: b0b576dc-3eef-4a85-9f0b-90bc3b6e178c, volume: 31e8131c-445c-4bb1-938f-a6731e976166, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d62142-bd04-47cc-971a-59003d300f83]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:58 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:04:58 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:59 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.795s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da062e-0a1a-4cbc-a2aa-6956b8a35c22]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:59 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:04:59 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:04:59 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.766s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 19:04:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:04:59 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 Jul 08 19:04:59 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:04 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166" returned: 0 in 4.320s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[807496eb-c9ef-432e-8c74-fa4176827b8a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:04 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:05:04 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:05 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.951s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:05:05 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Converted 1024.00 MB image at 236.94 MB/s Jul 08 19:05:05 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 is being set with open permissions: ugo+rw Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:05 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 Jul 08 19:05:05 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:05 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166" returned: 0 in 0.612s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" released by "_copy_volume_from_snapshot" :: held 7.533s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-31e8131c-445c-4bb1-938f-a6731e976166" released by "_create_volume_from_snapshot" :: held 7.561s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.575s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eaf55d-df96-4c57-8a7d-755332d9138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e8131c-445c-4bb1-938f-a6731e976166', 'volume_size': 1, 'snapshot_id': 'b0b576dc-3eef-4a85-9f0b-90bc3b6e178c'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae96f0a0-6d59-4986-af69-a8949639547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Volume volume-31e8131c-445c-4bb1-938f-a6731e976166 (31e8131c-445c-4bb1-938f-a6731e976166): created successfully Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae96f0a0-6d59-4986-af69-a8949639547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Flow 'volume_create_manager' (904674a5-edbd-46c5-b5b9-f57500359725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e8f8bbdd-3c16-47c9-b09e-3e64ce2f8828 tempest-VolumeDependencyTests-2007064424 None] Created volume successfully. Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Deleting offline snapshot b0b576dc-3eef-4a85-9f0b-90bc3b6e178c of volume a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] snapshot_file for this snap is: volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e53a7f-b83f-4298-8d13-ddbeaefc4412]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:06 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:05:06 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:07 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.775s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:05:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc53115-6e53-4651-8659-37dc78da7b39]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:07 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:05:07 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:08 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.865s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:08 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:05:08 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:09 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:09 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c Jul 08 19:05:09 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:09 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad.b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" returned: 0 in 0.636s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c" released by "_delete_snapshot" :: held 3.097s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" released by "delete_snapshot" :: held 3.122s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Created reservations ['46d3bd81-6e8f-404f-b23a-235b31149a04', '34f16b3d-8794-4cb6-bcb7-c31973ac35a5', '73c60387-c8db-4db5-9767-ed648fb2d0ad', '24e3b371-aa22-476b-b7ca-a535de9cc4cb'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Delete snapshot completed successfully. Jul 08 19:05:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-540d1911-25ba-4383-b3e0-75a2323457bc tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-b0b576dc-3eef-4a85-9f0b-90bc3b6e178c-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-a2e42d3e-bc79-46f0-9eb1-7687816618ad-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-a2e42d3e-bc79-46f0-9eb1-7687816618ad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885502e-7fe5-4170-b3f0-31ab05914e14]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:11 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:05:11 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:11 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.738s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:11 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad Jul 08 19:05:11 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:12 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2e42d3e-bc79-46f0-9eb1-7687816618ad" returned: 0 in 0.638s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-a2e42d3e-bc79-46f0-9eb1-7687816618ad" released by "delete_volume" :: held 1.431s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Created reservations ['b05915f8-88af-4125-b4ff-a43919a5a39c', 'b9880c89-9e90-4f12-8a5b-f835fa5eb6f3', '87faffa6-9510-4da0-a1b3-ab912eee2955', '48733d87-3b1e-4002-9ced-dc415ddefb6f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:12 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:12 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:13 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-31e8131c-445c-4bb1-938f-a6731e976166-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Deleted volume successfully. Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-31e8131c-445c-4bb1-938f-a6731e976166-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae0cd8db-7b87-4b5b-a2aa-e9818f31e9b7 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-a2e42d3e-bc79-46f0-9eb1-7687816618ad-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" acquired by "delete_volume" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97db1af-0b2c-472f-b775-2bcf262964d6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:13 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 Jul 08 19:05:13 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:14 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:14 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166 Jul 08 19:05:14 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:14 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-31e8131c-445c-4bb1-938f-a6731e976166" returned: 0 in 0.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-quobyte-31e8131c-445c-4bb1-938f-a6731e976166" released by "delete_volume" :: held 1.486s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Created reservations ['b823aae7-b3a9-43e7-9625-e39117033725', 'e045b43f-6ac6-483f-a7e4-594ebfdebe32', 'b2eb6a12-218d-4ee2-9744-7c8e7daea15a', '8dd03fff-9b90-4c15-8525-bb4ebd50a0d5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:14 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:14 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:15 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.683s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:15 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Deleted volume successfully. Jul 08 19:05:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-216b4771-4765-4330-bbcc-ae87eacb9179 tempest-VolumeDependencyTests-2007064424 None] Lock "cinder-31e8131c-445c-4bb1-938f-a6731e976166-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:18 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:18 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:18 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:05:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (c3049e26-a0a2-44d8-8a82-4700e79499c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1761391-2628-4ada-8aec-d65639ff3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1761391-2628-4ada-8aec-d65639ff3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518489608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8c1d43-baa6-462c-a8c6-9953043c0047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:23Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b0d662-2ba6-43f8-96b0-70a260fdf2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b0d662-2ba6-43f8-96b0-70a260fdf2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faeb50a-5c60-48a5-87d5-dbc7ff02df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faeb50a-5c60-48a5-87d5-dbc7ff02df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8c1d43-baa6-462c-a8c6-9953043c0047', 'volume_name': 'volume-aa8c1d43-baa6-462c-a8c6-9953043c0047', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d492c31-caf7-4376-a3aa-d2b35189f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d492c31-caf7-4376-a3aa-d2b35189f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506501da-c199-4597-a7ab-fdf333b3b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Volume aa8c1d43-baa6-462c-a8c6-9953043c0047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8c1d43-baa6-462c-a8c6-9953043c0047', 'volume_size': 1} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518489608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8c1d43-baa6-462c-a8c6-9953043c0047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:23Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Creating volume aa8c1d43-baa6-462c-a8c6-9953043c0047 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:22 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:22 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 1073741824 Jul 08 19:05:22 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:23 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 1073741824" returned: 0 in 0.817s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:23 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 Jul 08 19:05:23 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:24 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047" returned: 0 in 0.647s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506501da-c199-4597-a7ab-fdf333b3b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8c1d43-baa6-462c-a8c6-9953043c0047', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f9eb3c-c9e9-4402-aacb-dc45765fd3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Volume volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 (aa8c1d43-baa6-462c-a8c6-9953043c0047): created successfully Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f9eb3c-c9e9-4402-aacb-dc45765fd3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (c3049e26-a0a2-44d8-8a82-4700e79499c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dfa6a4de-8806-407e-b2ac-724c3870c3c9 tempest-ProjectReaderTests-332306805 None] Created volume successfully. Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-aa8c1d43-baa6-462c-a8c6-9953043c0047-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "cinder-aa8c1d43-baa6-462c-a8c6-9953043c0047-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-quobyte-aa8c1d43-baa6-462c-a8c6-9953043c0047" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-aa8c1d43-baa6-462c-a8c6-9953043c0047" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01908fff-4b87-4bba-b5d0-8a63752f4b27]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:25 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 Jul 08 19:05:25 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:25 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047" returned: 0 in 0.760s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:25 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047 Jul 08 19:05:25 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:26 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-aa8c1d43-baa6-462c-a8c6-9953043c0047" returned: 0 in 0.699s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-aa8c1d43-baa6-462c-a8c6-9953043c0047" released by "delete_volume" :: held 1.498s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Created reservations ['f126568c-f059-4ce2-ae98-cb54fe563e2e', 'ba11ca46-dfaa-496b-9168-85530ccbe8cf', '8e11283a-827a-4b1f-b378-e26f00f08394', '247adc5d-83f1-4548-ac11-498dc9ff8fef'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:26 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:26 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:27 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.678s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Deleted volume successfully. Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6d706eb-b448-4a68-b151-74350bf8c451 tempest-ProjectReaderTests-332306805 None] Lock "cinder-aa8c1d43-baa6-462c-a8c6-9953043c0047-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (ea33a24a-db96-46ea-8aaf-a35f3398a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f48ee-66a7-4e06-8736-ad7d162c42d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f48ee-66a7-4e06-8736-ad7d162c42d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-445167236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f76044-b07d-42e1-9b05-2407fde41d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:28Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8b4b69-8d67-4c02-b7f7-7891fd4a6a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8b4b69-8d67-4c02-b7f7-7891fd4a6a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b4da4a-48e5-4510-9d01-7bc6e153f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b4da4a-48e5-4510-9d01-7bc6e153f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f76044-b07d-42e1-9b05-2407fde41d38', 'volume_name': 'volume-c5f76044-b07d-42e1-9b05-2407fde41d38', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73520a4-ebc4-4ea7-9d16-99d01e1eee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73520a4-ebc4-4ea7-9d16-99d01e1eee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e0cdc6-81b2-4f5a-9e52-47ca0ccdb202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:27 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Volume c5f76044-b07d-42e1-9b05-2407fde41d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f76044-b07d-42e1-9b05-2407fde41d38', 'volume_size': 1} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-445167236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f76044-b07d-42e1-9b05-2407fde41d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:28Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Creating volume c5f76044-b07d-42e1-9b05-2407fde41d38 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:27 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:27 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 1073741824 Jul 08 19:05:27 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:28 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 1073741824" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:28 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=100,cinder:DELETE=8,cinder:SELECT=66,cinder:INSERT=18 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:05:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:28 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 Jul 08 19:05:28 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:29 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38" returned: 0 in 0.649s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e0cdc6-81b2-4f5a-9e52-47ca0ccdb202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f76044-b07d-42e1-9b05-2407fde41d38', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231201c8-2543-4027-beec-5a1425052c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:29 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Volume volume-c5f76044-b07d-42e1-9b05-2407fde41d38 (c5f76044-b07d-42e1-9b05-2407fde41d38): created successfully Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231201c8-2543-4027-beec-5a1425052c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (ea33a24a-db96-46ea-8aaf-a35f3398a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-30482bd3-d30f-4bb2-95aa-e30865f98b7d tempest-ProjectReaderTests-332306805 None] Created volume successfully. Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-c5f76044-b07d-42e1-9b05-2407fde41d38-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "cinder-c5f76044-b07d-42e1-9b05-2407fde41d38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-quobyte-c5f76044-b07d-42e1-9b05-2407fde41d38" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-c5f76044-b07d-42e1-9b05-2407fde41d38" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e98d33-0939-448a-9345-92b138852a96]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:29 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 Jul 08 19:05:30 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:30 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:30 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38 Jul 08 19:05:30 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:31 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c5f76044-b07d-42e1-9b05-2407fde41d38" returned: 0 in 0.622s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-c5f76044-b07d-42e1-9b05-2407fde41d38" released by "delete_volume" :: held 1.420s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Created reservations ['5fb1234b-5e69-4510-9ad7-1393ef28fe1c', 'ba32328d-fe09-4055-9191-bfd92d942300', '0ab7b712-78ab-4486-b701-b750612617d1', 'b19b976d-6dc3-4ad6-b4ca-857974a8ae93'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:31 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:31 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:32 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.624s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Deleted volume successfully. Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-78e56588-18be-48ec-96bc-4f657ca80ba0 tempest-ProjectReaderTests-332306805 None] Lock "cinder-c5f76044-b07d-42e1-9b05-2407fde41d38-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (700c900b-ed78-45b0-9bc6-fd898048dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3219ab14-2a9d-409f-8416-bf9eb901b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3219ab14-2a9d-409f-8416-bf9eb901b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509349784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fd4cc3-2208-4885-9578-15a79af6556d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:32Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa8b37-32ab-41ef-a987-507c99211b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa8b37-32ab-41ef-a987-507c99211b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33d7c5a-72b2-461e-890c-d3f6c18dae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33d7c5a-72b2-461e-890c-d3f6c18dae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fd4cc3-2208-4885-9578-15a79af6556d', 'volume_name': 'volume-a2fd4cc3-2208-4885-9578-15a79af6556d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e7bae3-43e8-4ee0-b631-6a8595ad82ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e7bae3-43e8-4ee0-b631-6a8595ad82ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6c391-0941-4275-ae63-ff9965810b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:32 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Volume a2fd4cc3-2208-4885-9578-15a79af6556d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fd4cc3-2208-4885-9578-15a79af6556d', 'volume_size': 1} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509349784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fd4cc3-2208-4885-9578-15a79af6556d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:32Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Creating volume a2fd4cc3-2208-4885-9578-15a79af6556d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:32 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:32 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d 1073741824 Jul 08 19:05:32 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:33 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d 1073741824" returned: 0 in 0.822s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:33 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d Jul 08 19:05:33 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:34 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d" returned: 0 in 0.685s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6c391-0941-4275-ae63-ff9965810b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fd4cc3-2208-4885-9578-15a79af6556d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba960569-0bd0-4803-bb64-aa2b49e69fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Volume volume-a2fd4cc3-2208-4885-9578-15a79af6556d (a2fd4cc3-2208-4885-9578-15a79af6556d): created successfully Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba960569-0bd0-4803-bb64-aa2b49e69fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (700c900b-ed78-45b0-9bc6-fd898048dc41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1e1b7f52-a00f-43e6-ba58-670959da2d29 tempest-ProjectReaderTests-332306805 None] Created volume successfully. Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-a2fd4cc3-2208-4885-9578-15a79af6556d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "cinder-a2fd4cc3-2208-4885-9578-15a79af6556d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-quobyte-a2fd4cc3-2208-4885-9578-15a79af6556d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-a2fd4cc3-2208-4885-9578-15a79af6556d" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31480503-b2e8-4ae8-8cd1-952607bfaeaa]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:34 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d Jul 08 19:05:34 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:35 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d" returned: 0 in 0.772s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:35 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d Jul 08 19:05:35 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:36 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a2fd4cc3-2208-4885-9578-15a79af6556d" returned: 0 in 0.658s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-a2fd4cc3-2208-4885-9578-15a79af6556d" released by "delete_volume" :: held 1.469s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Created reservations ['9283854b-2a95-4245-98e6-96abf0c6c9d8', 'a500e2ca-6067-4b6e-9f75-e4a9e3d27f70', '185c0a9e-f2f9-4d5f-9e8b-5c767693f622', 'c66825b4-27d0-45f0-a797-a4d58fee4b9f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:36 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:36 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:36 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Deleted volume successfully. Jul 08 19:05:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e3ade040-e86c-4a73-a835-5a86781c4801 tempest-ProjectReaderTests-332306805 None] Lock "cinder-a2fd4cc3-2208-4885-9578-15a79af6556d-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (75c7b6dd-bd96-445a-a4e0-edb3e82da3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6495b93b-1a73-48b0-bf64-d1eea9327ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6495b93b-1a73-48b0-bf64-d1eea9327ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858916159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87af28c-f019-432c-ab54-6ae54e94c32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:37Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815c4a8-cb6e-4bfa-b94c-de53280dde15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815c4a8-cb6e-4bfa-b94c-de53280dde15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f0c94-cf84-4a14-9fdf-6e60502dc84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f0c94-cf84-4a14-9fdf-6e60502dc84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87af28c-f019-432c-ab54-6ae54e94c32a', 'volume_name': 'volume-f87af28c-f019-432c-ab54-6ae54e94c32a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b55db-2a29-4706-b7d6-b1f49efb4f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b55db-2a29-4706-b7d6-b1f49efb4f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9043be-8dba-4078-9f58-083fe86de5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:37 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Volume f87af28c-f019-432c-ab54-6ae54e94c32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87af28c-f019-432c-ab54-6ae54e94c32a', 'volume_size': 1} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858916159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87af28c-f019-432c-ab54-6ae54e94c32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f683983967614a6c93718e18efbd3efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:37Z,use_quota=True,user_id='a841d64247404b5c8c0665a6f0f833f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Creating volume f87af28c-f019-432c-ab54-6ae54e94c32a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:37 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:37 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a 1073741824 Jul 08 19:05:37 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:38 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a 1073741824" returned: 0 in 0.808s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:38 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a Jul 08 19:05:38 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:38 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9043be-8dba-4078-9f58-083fe86de5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87af28c-f019-432c-ab54-6ae54e94c32a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516f27a-f7f3-469e-824b-b0492bc6b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Volume volume-f87af28c-f019-432c-ab54-6ae54e94c32a (f87af28c-f019-432c-ab54-6ae54e94c32a): created successfully Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d516f27a-f7f3-469e-824b-b0492bc6b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Flow 'volume_create_manager' (75c7b6dd-bd96-445a-a4e0-edb3e82da3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-32e6e1eb-d10a-4687-a14c-cf05dff4f12c tempest-ProjectReaderTests-332306805 None] Created volume successfully. Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-f87af28c-f019-432c-ab54-6ae54e94c32a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "cinder-f87af28c-f019-432c-ab54-6ae54e94c32a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Acquiring lock "cinder-quobyte-f87af28c-f019-432c-ab54-6ae54e94c32a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-f87af28c-f019-432c-ab54-6ae54e94c32a" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f88c86d-e767-4a71-9e7c-abc3cfdc8256]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:39 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a Jul 08 19:05:39 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:40 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:40 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a Jul 08 19:05:40 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:40 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-f87af28c-f019-432c-ab54-6ae54e94c32a" returned: 0 in 0.618s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "cinder-quobyte-f87af28c-f019-432c-ab54-6ae54e94c32a" released by "delete_volume" :: held 1.408s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Created reservations ['7fbea2bd-c2ca-45eb-b59b-54713c619269', '06211872-5107-49af-b89d-836c63ec0539', 'dd99bb01-dfd6-4bf1-8956-c4729da4f9c0', '8395409a-3e24-4a9e-87ac-0779c1688d20'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:40 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:05:40 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:41 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:41 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:05:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Deleted volume successfully. Jul 08 19:05:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-19e09ec6-8490-4fdd-835c-bb681d14caca tempest-ProjectReaderTests-332306805 None] Lock "cinder-f87af28c-f019-432c-ab54-6ae54e94c32a-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:05:50 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=71,cinder:SELECT=47,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:05:51 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=29,cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=4 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (02cc46d4-e18a-4647-a82b-b01f48a0def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994517a5-72cb-4f14-a9a3-4c9ed82d5d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994517a5-72cb-4f14-a9a3-4c9ed82d5d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834169983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c26d4e-6145-4033-a7dd-774bc71a73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c26d4e-6145-4033-a7dd-774bc71a73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4f46d0-1a21-4916-8e26-f1160cf0810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4f46d0-1a21-4916-8e26-f1160cf0810d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92', 'volume_name': 'volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5019af7-24f5-49af-9673-900483dd22af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5019af7-24f5-49af-9673-900483dd22af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eda3ff1-9777-4b22-a6c0-1a5e6db2cba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92', 'volume_size': 1} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834169983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:54 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:54 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 1073741824 Jul 08 19:05:54 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (61164880-de98-4feb-bc6f-2881cf24c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d3e29-a804-4c72-a5ec-82aa99e55c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d3e29-a804-4c72-a5ec-82aa99e55c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369253707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20840d64-5887-4827-969f-a957289d1ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551ad93-fbf3-405a-8dca-97500ef20195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e551ad93-fbf3-405a-8dca-97500ef20195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e8e80e-88ba-4234-b70e-0f53efdbbe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e8e80e-88ba-4234-b70e-0f53efdbbe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20840d64-5887-4827-969f-a957289d1ef5', 'volume_name': 'volume-20840d64-5887-4827-969f-a957289d1ef5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b2489-f0a9-47d5-9f87-6be2cf5be5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b2489-f0a9-47d5-9f87-6be2cf5be5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dc85c1-517b-40be-a8e6-e27ab9458c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Volume 20840d64-5887-4827-969f-a957289d1ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20840d64-5887-4827-969f-a957289d1ef5', 'volume_size': 1} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (d639a1ec-49a2-415b-9a31-3854c8b973d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf6d98c-44c5-4ca4-9964-6a448a4c0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf6d98c-44c5-4ca4-9964-6a448a4c0225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-553637469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92372d5b-d7af-4ef6-9ff3-bc463606fc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d79f9-3344-48c2-ac37-692a4945497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6d79f9-3344-48c2-ac37-692a4945497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565ca56d-e0c0-4d68-9373-2d9732edf855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565ca56d-e0c0-4d68-9373-2d9732edf855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92372d5b-d7af-4ef6-9ff3-bc463606fc44', 'volume_name': 'volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e91e29a-1c0d-423c-b8cf-1ef7269aec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e91e29a-1c0d-423c-b8cf-1ef7269aec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52e2b2c-05aa-4f48-aee9-f105a684b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Volume 92372d5b-d7af-4ef6-9ff3-bc463606fc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44', 'volume_size': 1} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (933cc3ff-4de3-4e97-846f-28654401a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc599f6-de1c-4318-8452-fe179271dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc599f6-de1c-4318-8452-fe179271dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1421528183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd32c200-98c0-4265-aa47-175df8fa46e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:55Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4a315-4ff5-4ff0-9b8c-e5b62fb039ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd4a315-4ff5-4ff0-9b8c-e5b62fb039ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0681f2a9-62fe-44b2-97ee-5d1b0fcf87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0681f2a9-62fe-44b2-97ee-5d1b0fcf87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd32c200-98c0-4265-aa47-175df8fa46e1', 'volume_name': 'volume-bd32c200-98c0-4265-aa47-175df8fa46e1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03886426-545d-420b-b5aa-628d10a7fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03886426-545d-420b-b5aa-628d10a7fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9de8370-6239-4a8e-8825-9b0813e97000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Volume bd32c200-98c0-4265-aa47-175df8fa46e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd32c200-98c0-4265-aa47-175df8fa46e1', 'volume_size': 1} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:55 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 1073741824" returned: 0 in 1.322s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:55 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 Jul 08 19:05:55 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (78c656c5-0556-40fb-9ce8-ea8412924e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d60f28-106c-4dc5-9293-2f45256a3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (4785efd6-7aee-4996-9335-f9b8a5bf245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1f938c-1abd-49ca-8995-aa422060ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1f938c-1abd-49ca-8995-aa422060ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1147386861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e34b07-0cfc-4aed-9357-9c4002174a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c14f62-3d62-43d3-9e31-462e9cad1531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c14f62-3d62-43d3-9e31-462e9cad1531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ce93d4-6bfb-48c5-86e7-8b7ad0343693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ce93d4-6bfb-48c5-86e7-8b7ad0343693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e34b07-0cfc-4aed-9357-9c4002174a0a', 'volume_name': 'volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d5c144-3f09-4e89-b11f-cb6a955123c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d5c144-3f09-4e89-b11f-cb6a955123c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a127a5-fd5a-4f08-90a2-891acd8f4269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Volume d6e34b07-0cfc-4aed-9357-9c4002174a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a', 'volume_size': 1} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d60f28-106c-4dc5-9293-2f45256a3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183605720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf7bef7-b20e-4705-bd88-d982d083eecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3f2b8-5b81-4aa4-9ea6-8edd1a08e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3f2b8-5b81-4aa4-9ea6-8edd1a08e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978b06f6-f84d-4da9-9afc-d741d770819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978b06f6-f84d-4da9-9afc-d741d770819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf7bef7-b20e-4705-bd88-d982d083eecf', 'volume_name': 'volume-faf7bef7-b20e-4705-bd88-d982d083eecf', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ef33d9-7c3b-4a50-98ee-dfb730339b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ef33d9-7c3b-4a50-98ee-dfb730339b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba2948e-fa18-4705-bd73-947a1449ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Volume faf7bef7-b20e-4705-bd88-d982d083eecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf7bef7-b20e-4705-bd88-d982d083eecf', 'volume_size': 1} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:55 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (d6eeee15-e6f9-4b1d-ba4e-f41973e4302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c977b-c85a-4119-a138-c7ff0740fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c977b-c85a-4119-a138-c7ff0740fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105033779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c585a5-750b-45b2-9634-44f0ad54011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a467a44-663c-4180-a49b-9a1d9a71b38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a467a44-663c-4180-a49b-9a1d9a71b38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec810bf1-5669-40c2-97f5-ad38656ebf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec810bf1-5669-40c2-97f5-ad38656ebf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c585a5-750b-45b2-9634-44f0ad54011c', 'volume_name': 'volume-05c585a5-750b-45b2-9634-44f0ad54011c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fe1956-81ad-44ce-bd23-75538538f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fe1956-81ad-44ce-bd23-75538538f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515af888-4b3d-4c24-a701-28c9f421510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Volume 05c585a5-750b-45b2-9634-44f0ad54011c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c585a5-750b-45b2-9634-44f0ad54011c', 'volume_size': 1} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:56 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" returned: 0 in 0.881s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (2256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369253707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20840d64-5887-4827-969f-a957289d1ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Creating volume 20840d64-5887-4827-969f-a957289d1ef5 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:56 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eda3ff1-9777-4b22-a6c0-1a5e6db2cba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 1073741824 Jul 08 19:05:56 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff7783f-dfaa-4a62-8811-2b2a5ddc76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:56 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 (bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92): created successfully Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff7783f-dfaa-4a62-8811-2b2a5ddc76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:56 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (02cc46d4-e18a-4647-a82b-b01f48a0def3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-11417e19-6c80-480e-8fb8-88efaaed0c96 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:05:57 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 1073741824" returned: 0 in 0.884s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:57 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 Jul 08 19:05:57 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (63d41da6-167a-4106-b2ab-7eaf4a35500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8512c72a-057b-4126-8caa-9d97639eb3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8512c72a-057b-4126-8caa-9d97639eb3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323910876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695335c5-0440-4ad4-aaa7-cf97a82bc34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:57Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8dd088-2af4-4e54-affb-b0d20c7581f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8dd088-2af4-4e54-affb-b0d20c7581f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3026a94d-2a68-49b4-ae79-3356fde55f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3026a94d-2a68-49b4-ae79-3356fde55f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695335c5-0440-4ad4-aaa7-cf97a82bc34c', 'volume_name': 'volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43db1638-b6c9-4ff6-a7f6-ad28b3de9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43db1638-b6c9-4ff6-a7f6-ad28b3de9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dc3f8b-f365-44d1-93fd-ae92d5c15ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume 695335c5-0440-4ad4-aaa7-cf97a82bc34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c', 'volume_size': 1} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (7a63fc21-5cb4-4e17-bdf8-ef3fcf88bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb27c81-a150-4dc9-be1a-6502635e0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb27c81-a150-4dc9-be1a-6502635e0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727680069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30723ee8-2579-45a8-b2c3-9265c7bd03c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:58Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cf3c9d-7f2e-45e1-90e0-3b26af19aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cf3c9d-7f2e-45e1-90e0-3b26af19aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f5b2b4-de78-404c-80c8-8ab32a9f5fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f5b2b4-de78-404c-80c8-8ab32a9f5fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30723ee8-2579-45a8-b2c3-9265c7bd03c1', 'volume_name': 'volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3834bdb-9542-446d-b05e-0ad7e1c61e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3834bdb-9542-446d-b05e-0ad7e1c61e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc18aa5a-870e-447a-b59b-1add39f79e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume 30723ee8-2579-45a8-b2c3-9265c7bd03c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1', 'volume_size': 1} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:58 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-553637469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92372d5b-d7af-4ef6-9ff3-bc463606fc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:54Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Creating volume 92372d5b-d7af-4ef6-9ff3-bc463606fc44 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:05:58 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dc85c1-517b-40be-a8e6-e27ab9458c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20840d64-5887-4827-969f-a957289d1ef5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01fa1d-6cf4-4999-a888-707a67a8c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 1073741824 Jul 08 19:05:58 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Volume volume-20840d64-5887-4827-969f-a957289d1ef5 (20840d64-5887-4827-969f-a957289d1ef5): created successfully Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01fa1d-6cf4-4999-a888-707a67a8c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (61164880-de98-4feb-bc6f-2881cf24c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3f503c71-129c-4270-9724-7343d5b73daf tempest-CreateVolumesFromImageTest-2084419910 None] Created volume successfully. Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (d8e14a27-be52-4cd8-9e7b-e20dc04841d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362f4ca3-dbe2-4a8e-ba58-cdec857d0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362f4ca3-dbe2-4a8e-ba58-cdec857d0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58340187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:58Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5bfd63-09b5-43ce-8c36-5d09dc845947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5bfd63-09b5-43ce-8c36-5d09dc845947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0244c30a-eb95-49a9-8ac9-1e9052d32893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0244c30a-eb95-49a9-8ac9-1e9052d32893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5', 'volume_name': 'volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f307fb-afca-453f-a992-0d13f60ae61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f307fb-afca-453f-a992-0d13f60ae61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd353c6-95ab-4fe0-ae8b-9a0f0d8c780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:58 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5', 'volume_size': 1} Jul 08 19:05:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:59 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (27d635fb-edd5-4ce7-9cdd-25ab242066af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26adb0c2-e4c0-4157-bbb5-9892985dfa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 1073741824" returned: 0 in 1.144s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26adb0c2-e4c0-4157-bbb5-9892985dfa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-963365736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b98d84-2b92-43c0-b379-63798ce52f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d431c3-c9f0-4090-8d6d-21291fe42043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d431c3-c9f0-4090-8d6d-21291fe42043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be056ed5-f3c1-4d4e-9fa6-ad341ef3cf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be056ed5-f3c1-4d4e-9fa6-ad341ef3cf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b98d84-2b92-43c0-b379-63798ce52f88', 'volume_name': 'volume-52b98d84-2b92-43c0-b379-63798ce52f88', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9345fae3-92a1-4f39-a37d-016a2a4f03d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9345fae3-92a1-4f39-a37d-016a2a4f03d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b91c2b-ea64-4e70-a07c-fb10f2aa6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume 52b98d84-2b92-43c0-b379-63798ce52f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b98d84-2b92-43c0-b379-63798ce52f88', 'volume_size': 1} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:59 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 Jul 08 19:05:59 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Flow 'volume_create_manager' (2b39392f-eb69-4a8f-95a8-83c9028f0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13129dd-4dc8-4ae0-a07f-9f3ebc2202d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13129dd-4dc8-4ae0-a07f-9f3ebc2202d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ffa27e-16ef-4fc6-8d0c-50bda74e7e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3a9ce9b289416181ac13cdd8ad9fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='206f3550ba464913977e0ea7301a603f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8b0a16-6cbf-483a-a0f8-ac66231df500),volume_type_id=cf8b0a16-6cbf-483a-a0f8-ac66231df500)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc87c8e-c883-48bc-9c59-358d3546f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc87c8e-c883-48bc-9c59-358d3546f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eecc3f-b570-4b30-a6f3-e6cd943a811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (15e703f6-1f63-4c00-afd2-c96c68950e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dd1745-c2b7-4510-bb2b-7033476f1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dd1745-c2b7-4510-bb2b-7033476f1500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336573489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d430cae0-2609-42d8-8b66-1460cce657a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665c4ecb-6612-4f2c-aa27-754a219e6ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665c4ecb-6612-4f2c-aa27-754a219e6ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e08d83-effa-465b-b07f-d099772da344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e08d83-effa-465b-b07f-d099772da344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd430cae0-2609-42d8-8b66-1460cce657a2', 'volume_name': 'volume-d430cae0-2609-42d8-8b66-1460cce657a2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2b14ce-3e39-489a-bf02-b3934605d060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2b14ce-3e39-489a-bf02-b3934605d060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad852418-6174-4f31-8377-95fabbf2acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume d430cae0-2609-42d8-8b66-1460cce657a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d430cae0-2609-42d8-8b66-1460cce657a2', 'volume_size': 1} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eecc3f-b570-4b30-a6f3-e6cd943a811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65ffa27e-16ef-4fc6-8d0c-50bda74e7e01', 'volume_name': 'volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01', 'volume_size': 1, 'image_id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f9a2d972ba7bb455c49f03ca013391d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3a9ce9b289416181ac13cdd8ad9fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdb580c07af877d14e6eaf03c8e677378e9d89c68b86f8173da6f47ac0b7d1f725c4228fcb030297085949bde814223c8b5a0be090a63a90a674092de6eabf9e', 'id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'created_at': datetime.datetime(2026, 7, 8, 17, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13573b28-41f1-4529-8160-2ca00aefcb06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17b776b-ab44-4444-983d-589d74e8ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17b776b-ab44-4444-983d-589d74e8ac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ef1714-bc71-42f1-8cbc-02402ff32dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:05:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01', 'volume_size': 1, 'image_id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f9a2d972ba7bb455c49f03ca013391d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3a9ce9b289416181ac13cdd8ad9fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdb580c07af877d14e6eaf03c8e677378e9d89c68b86f8173da6f47ac0b7d1f725c4228fcb030297085949bde814223c8b5a0be090a63a90a674092de6eabf9e', 'id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'created_at': datetime.datetime(2026, 7, 8, 17, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13573b28-41f1-4529-8160-2ca00aefcb06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Trying to clone 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 from image 13573b28-41f1-4529-8160-2ca00aefcb06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 19:05:59 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a87c6-c84b-4697-b30e-e9a2cc0b613f]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:05:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:00 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:00 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:00 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44" returned: 0 in 0.686s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.103s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1421528183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd32c200-98c0-4265-aa47-175df8fa46e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:55Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Creating volume bd32c200-98c0-4265-aa47-175df8fa46e1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:00 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:00 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 1073741824 Jul 08 19:06:00 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52e2b2c-05aa-4f48-aee9-f105a684b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29ae1a1-99ac-43b8-b38c-d5c41ea50cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:00 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Volume volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 (92372d5b-d7af-4ef6-9ff3-bc463606fc44): created successfully Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29ae1a1-99ac-43b8-b38c-d5c41ea50cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (d639a1ec-49a2-415b-9a31-3854c8b973d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:00 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ab48d2a6-bc47-4e91-82ea-82d19fde1156 tempest-CreateVolumesFromImageTest-2084419910 None] Created volume successfully. Jul 08 19:06:00 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:00 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:00 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:00 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 1073741824" returned: 0 in 0.849s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:01 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 Jul 08 19:06:01 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:01 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 1 in 0.750s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Temporary image 13573b28-41f1-4529-8160-2ca00aefcb06 is fetched for user 206f3550ba464913977e0ea7301a603f. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[693539fe-110a-4616-91fb-6b68979782f5]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:01 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:01 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:01 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1" returned: 0 in 0.640s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.729s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1147386861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e34b07-0cfc-4aed-9357-9c4002174a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Creating volume d6e34b07-0cfc-4aed-9357-9c4002174a0a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:01 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9de8370-6239-4a8e-8825-9b0813e97000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd32c200-98c0-4265-aa47-175df8fa46e1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:01 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a 1073741824 Jul 08 19:06:01 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4b5a02-8f74-48f5-a098-51ebce651888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:01 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Volume volume-bd32c200-98c0-4265-aa47-175df8fa46e1 (bd32c200-98c0-4265-aa47-175df8fa46e1): created successfully Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4b5a02-8f74-48f5-a098-51ebce651888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:01 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (933cc3ff-4de3-4e97-846f-28654401a84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-409a699c-1b97-4192-99af-99418c1acfde tempest-CreateVolumesFromImageTest-2084419910 None] Created volume successfully. Jul 08 19:06:02 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:02 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:02 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:02 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a 1073741824" returned: 0 in 0.841s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:02 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a Jul 08 19:06:02 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:03 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:03 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a" returned: 0 in 0.641s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.207s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183605720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf7bef7-b20e-4705-bd88-d982d083eecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Creating volume faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:03 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a127a5-fd5a-4f08-90a2-891acd8f4269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:03 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf 1073741824 Jul 08 19:06:03 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc14c026-78d4-4b3f-90f2-4f43cd80082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Volume volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a (d6e34b07-0cfc-4aed-9357-9c4002174a0a): created successfully Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc14c026-78d4-4b3f-90f2-4f43cd80082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (4785efd6-7aee-4996-9335-f9b8a5bf245d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3dfc4b8b-9e87-4ba8-b6c2-9848f44edc17 tempest-CreateVolumesFromImageTest-2084419910 None] Created volume successfully. Jul 08 19:06:04 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf 1073741824" returned: 0 in 0.880s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:04 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf Jul 08 19:06:04 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:04 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf" returned: 0 in 0.646s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.684s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105033779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c585a5-750b-45b2-9634-44f0ad54011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa52770e91464c7780026d8020b4d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:56Z,use_quota=True,user_id='91c51392500e4464949368f75f1adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Creating volume 05c585a5-750b-45b2-9634-44f0ad54011c {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:04 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:04 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c 1073741824 Jul 08 19:06:04 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba2948e-fa18-4705-bd73-947a1449ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf7bef7-b20e-4705-bd88-d982d083eecf', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623ab197-30e2-407d-a638-48305c2321bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:04 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Volume volume-faf7bef7-b20e-4705-bd88-d982d083eecf (faf7bef7-b20e-4705-bd88-d982d083eecf): created successfully Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623ab197-30e2-407d-a638-48305c2321bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:04 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (78c656c5-0556-40fb-9ce8-ea8412924e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:04 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-be2789be-1817-4f08-bc5a-c5a6d9dac88a tempest-ProjectReaderTests-290467064 None] Created volume successfully. Jul 08 19:06:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:05 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c 1073741824" returned: 0 in 0.847s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:05 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c Jul 08 19:06:05 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:06 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c" returned: 0 in 0.668s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.789s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323910876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695335c5-0440-4ad4-aaa7-cf97a82bc34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:57Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume 695335c5-0440-4ad4-aaa7-cf97a82bc34c {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:06 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515af888-4b3d-4c24-a701-28c9f421510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c585a5-750b-45b2-9634-44f0ad54011c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:06 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c 1073741824 Jul 08 19:06:06 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2709bab2-2319-471a-b73c-0179e6fc8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:06 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Volume volume-05c585a5-750b-45b2-9634-44f0ad54011c (05c585a5-750b-45b2-9634-44f0ad54011c): created successfully Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2709bab2-2319-471a-b73c-0179e6fc8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Flow 'volume_create_manager' (d6eeee15-e6f9-4b1d-ba4e-f41973e4302f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e8311f27-ed77-4c27-8837-f6223286f3e7 tempest-CreateVolumesFromImageTest-2084419910 None] Created volume successfully. Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-05c585a5-750b-45b2-9634-44f0ad54011c-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-05c585a5-750b-45b2-9634-44f0ad54011c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-quobyte-05c585a5-750b-45b2-9634-44f0ad54011c" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-05c585a5-750b-45b2-9634-44f0ad54011c" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd6b6d-86e0-42a4-b5df-514bb7ed6bb8]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:07 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c 1073741824" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:07 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c Jul 08 19:06:07 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:07 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c Jul 08 19:06:07 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:07 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:07 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c" returned: 0 in 0.688s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.936s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727680069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30723ee8-2579-45a8-b2c3-9265c7bd03c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:58Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume 30723ee8-2579-45a8-b2c3-9265c7bd03c1 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:07 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:07 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:07 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dc3f8b-f365-44d1-93fd-ae92d5c15ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:07 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 1073741824 Jul 08 19:06:07 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb8b3cb-2230-4280-9b92-84c2219460fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c (695335c5-0440-4ad4-aaa7-cf97a82bc34c): created successfully Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb8b3cb-2230-4280-9b92-84c2219460fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (63d41da6-167a-4106-b2ab-7eaf4a35500e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dc01f568-6968-47bf-86a8-4d8f10089fa9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:06:08 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-05c585a5-750b-45b2-9634-44f0ad54011c" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-05c585a5-750b-45b2-9634-44f0ad54011c" released by "delete_volume" :: held 1.504s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Created reservations ['a3075deb-95aa-424b-a2a8-74bf3480e6b0', '36119e09-6a6d-4526-beaf-2edef1fc5ce9', '05240ac3-b227-42c7-a8af-30f3cb4769df', '9f81582f-5fdf-4808-83e1-5eb0abc5d201'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:08 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:08 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:08 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 1073741824" returned: 0 in 0.936s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:08 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 Jul 08 19:06:08 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-d6e34b07-0cfc-4aed-9357-9c4002174a0a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-d6e34b07-0cfc-4aed-9357-9c4002174a0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-quobyte-d6e34b07-0cfc-4aed-9357-9c4002174a0a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-d6e34b07-0cfc-4aed-9357-9c4002174a0a" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35325fc2-ced4-4051-98c0-b8c8e4f9b36d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:09 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.735s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Deleted volume successfully. Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b6a534d-71a8-46f2-bc3b-4e5efdde0c26 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-05c585a5-750b-45b2-9634-44f0ad54011c-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:09 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a Jul 08 19:06:09 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:09 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1" returned: 0 in 0.690s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.048s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58340187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:58Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:09 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:09 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 1073741824 Jul 08 19:06:09 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc18aa5a-870e-447a-b59b-1add39f79e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ec819-f72c-423e-ab14-9d4823cd559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:09 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 (30723ee8-2579-45a8-b2c3-9265c7bd03c1): created successfully Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ec819-f72c-423e-ab14-9d4823cd559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:09 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (7a63fc21-5cb4-4e17-bdf8-ef3fcf88bf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:09 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d6104dab-8799-4506-839c-8afb0c580c7e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:06:10 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a" returned: 0 in 0.825s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:10 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a Jul 08 19:06:10 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:10 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 1073741824" returned: 0 in 0.910s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:10 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 Jul 08 19:06:10 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:10 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d6e34b07-0cfc-4aed-9357-9c4002174a0a" returned: 0 in 0.669s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-d6e34b07-0cfc-4aed-9357-9c4002174a0a" released by "delete_volume" :: held 1.559s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:10 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Created reservations ['67b173c8-cada-4299-892a-b2b2f7239ef5', 'ea0d0de9-9364-4ae7-ad7e-274103cd7147', '596ebc58-707f-41b7-ac82-37b86a7a63a1', '9eab5d60-f2ff-43ea-82ae-cd967fb1fb5f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:11 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:11 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:11 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" returned: 0 in 0.675s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.934s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-963365736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b98d84-2b92-43c0-b379-63798ce52f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume 52b98d84-2b92-43c0-b379-63798ce52f88 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:11 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd353c6-95ab-4fe0-ae8b-9a0f0d8c780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:11 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 1073741824 Jul 08 19:06:11 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1068d4-7c2b-43e0-9777-4f2147532c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:11 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 (c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5): created successfully Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1068d4-7c2b-43e0-9777-4f2147532c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (d8e14a27-be52-4cd8-9e7b-e20dc04841d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0d3c8c51-b4f4-4e28-8670-255485b96ba9 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-bd32c200-98c0-4265-aa47-175df8fa46e1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-bd32c200-98c0-4265-aa47-175df8fa46e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-quobyte-bd32c200-98c0-4265-aa47-175df8fa46e1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-bd32c200-98c0-4265-aa47-175df8fa46e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac85486-2154-435a-9a7a-8acebaa5a71c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:11 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.758s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Deleted volume successfully. Jul 08 19:06:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-11a0b454-37e3-4782-a810-c90dd386b84f tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-d6e34b07-0cfc-4aed-9357-9c4002174a0a-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:11 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 Jul 08 19:06:11 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:12 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 1073741824" returned: 0 in 0.902s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:12 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 Jul 08 19:06:12 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:12 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:12 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1 Jul 08 19:06:12 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:12 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88" returned: 0 in 0.665s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.274s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336573489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d430cae0-2609-42d8-8b66-1460cce657a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd5848da1d646b4a9ab6c7b26256764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='b1461158b9a546e7a805d904b8b43c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Creating volume d430cae0-2609-42d8-8b66-1460cce657a2 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:12 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b91c2b-ea64-4e70-a07c-fb10f2aa6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b98d84-2b92-43c0-b379-63798ce52f88', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2fb1cd-7e6e-43a5-9b62-a3ba5a75de83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:12 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 1073741824 Jul 08 19:06:12 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:12 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-52b98d84-2b92-43c0-b379-63798ce52f88 (52b98d84-2b92-43c0-b379-63798ce52f88): created successfully Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2fb1cd-7e6e-43a5-9b62-a3ba5a75de83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:12 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (27d635fb-edd5-4ce7-9cdd-25ab242066af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2370e4b3-6eac-4835-bd75-a6f1b2d40ead tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:06:13 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bd32c200-98c0-4265-aa47-175df8fa46e1" returned: 0 in 0.692s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-bd32c200-98c0-4265-aa47-175df8fa46e1" released by "delete_volume" :: held 1.522s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Created reservations ['7d379911-a510-4280-900b-cf31f0b0960f', '14c7bac9-d2ad-46b8-8f17-cb25695e8aed', 'd4a9697e-b2bd-4447-863d-23a88ec24e9b', '01d441a5-8ddb-4ddc-a7cd-e8b759bfd588'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:13 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:13 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:13 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 1073741824" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:13 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 Jul 08 19:06:13 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-92372d5b-d7af-4ef6-9ff3-bc463606fc44-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-92372d5b-d7af-4ef6-9ff3-bc463606fc44-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-quobyte-92372d5b-d7af-4ef6-9ff3-bc463606fc44" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-92372d5b-d7af-4ef6-9ff3-bc463606fc44" acquired by "delete_volume" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:14 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.694s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Deleted volume successfully. Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63674bac-bdc6-4885-be27-3a131ddd8815]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-117074b7-b4e7-4f53-b1fc-421253609f97 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-bd32c200-98c0-4265-aa47-175df8fa46e1-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:14 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 Jul 08 19:06:14 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:14 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.457s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ffa27e-16ef-4fc6-8d0c-50bda74e7e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3a9ce9b289416181ac13cdd8ad9fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:05:59Z,use_quota=True,user_id='206f3550ba464913977e0ea7301a603f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8b0a16-6cbf-483a-a0f8-ac66231df500),volume_type_id=cf8b0a16-6cbf-483a-a0f8-ac66231df500)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Creating volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:14 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:14 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1073741824 Jul 08 19:06:14 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad852418-6174-4f31-8377-95fabbf2acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d430cae0-2609-42d8-8b66-1460cce657a2', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6f3b96-7e2c-4eb9-9c9a-0e8a73f14d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Volume volume-d430cae0-2609-42d8-8b66-1460cce657a2 (d430cae0-2609-42d8-8b66-1460cce657a2): created successfully Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6f3b96-7e2c-4eb9-9c9a-0e8a73f14d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Flow 'volume_create_manager' (15e703f6-1f63-4c00-afd2-c96c68950e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c7c789db-0473-4c87-b483-133890bfff5f tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created volume successfully. Jul 08 19:06:14 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44" returned: 0 in 0.872s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:14 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44 Jul 08 19:06:14 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:15 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1073741824" returned: 0 in 0.933s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-d430cae0-2609-42d8-8b66-1460cce657a2-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-d430cae0-2609-42d8-8b66-1460cce657a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:15 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-d430cae0-2609-42d8-8b66-1460cce657a2" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:15 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-d430cae0-2609-42d8-8b66-1460cce657a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[761e8e67-f4a1-4920-80ba-13e0c58d0511]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:15 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-92372d5b-d7af-4ef6-9ff3-bc463606fc44" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-92372d5b-d7af-4ef6-9ff3-bc463606fc44" released by "delete_volume" :: held 1.703s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:15 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 Jul 08 19:06:15 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Created reservations ['8776f5a4-67db-4046-8d11-2ddd51173557', 'fe3d4353-be5e-41a3-89e3-d4627d35d1c0', '29ace200-6022-4ef5-a1e4-5503fe33e04d', '33a14f65-f000-46b7-8b3d-27fb49b73be2'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:15 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:15 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-20840d64-5887-4827-969f-a957289d1ef5-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-20840d64-5887-4827-969f-a957289d1ef5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:16 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 0 in 0.731s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.860s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Creating offline snapshot ffefb7d3-b118-4714-93b2-aae4f1860f24 of volume faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "cinder-quobyte-20840d64-5887-4827-969f-a957289d1ef5" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb344fb3-7d57-4973-a035-f82e7f01c5e7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Attempting download of 13573b28-41f1-4529-8160-2ca00aefcb06 ((None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}])) to volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-20840d64-5887-4827-969f-a957289d1ef5" acquired by "delete_volume" :: waited 0.042s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ff932-5460-4133-9d47-885fa2bf8ff6]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a41cdd-2273-4632-b82b-90c34fb53ab9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:16 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf Jul 08 19:06:16 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:16 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2 Jul 08 19:06:16 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:16 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 Jul 08 19:06:16 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:16 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2" returned: 0 in 0.974s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:16 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2 Jul 08 19:06:16 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:16 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:16 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Deleted volume successfully. Jul 08 19:06:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-d0dd5283-5f93-44d6-ae43-15cfab007fb3 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-92372d5b-d7af-4ef6-9ff3-bc463606fc44-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:17 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2" returned: 0 in 0.854s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:17 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf" returned: 0 in 0.940s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:17 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 1G Jul 08 19:06:17 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:17 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2 Jul 08 19:06:17 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:17 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5" returned: 0 in 1.030s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:17 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5 Jul 08 19:06:17 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:17 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d430cae0-2609-42d8-8b66-1460cce657a2" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-d430cae0-2609-42d8-8b66-1460cce657a2" released by "delete_volume" :: held 1.949s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['214a55db-7725-489b-8ada-307ba62ecdd2', '2d0e4b35-27ea-45d6-a707-a2c722a3315b', '243182b3-7ce1-4141-ba9c-cac41c767c15', 'f3beeee7-ca04-44df-8f01-94a14b8f2901'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:17 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:17 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-52b98d84-2b92-43c0-b379-63798ce52f88-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-52b98d84-2b92-43c0-b379-63798ce52f88-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-52b98d84-2b92-43c0-b379-63798ce52f88" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-52b98d84-2b92-43c0-b379-63798ce52f88" acquired by "delete_volume" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b9d5e-e9ef-48c1-9364-85e7315c2f95]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:18 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 Jul 08 19:06:18 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:18 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2" returned: 1 in 1.011s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13573b28-41f1-4529-8160-2ca00aefcb06_5yqo2fx2' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a8ede0-7274-4a48-a081-ea15e3b83ab3]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:18 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:18 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:18 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-20840d64-5887-4827-969f-a957289d1ef5" returned: 0 in 0.923s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-quobyte-20840d64-5887-4827-969f-a957289d1ef5" released by "delete_volume" :: held 2.051s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:18 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:18 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Created reservations ['207c676c-6360-4586-9fce-45f2110a1a57', 'ad87b5e0-03a6-4516-b37d-b1850794b302', '260fd89c-5b92-4e36-9242-23cdf65c6bdf', 'a7b25967-4554-44c8-aa87-5931cb18c05d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:18 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 1G" returned: 0 in 1.425s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf7bef7-b20e-4705-bd88-d982d083eecf -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:18 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf7bef7-b20e-4705-bd88-d982d083eecf -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 Jul 08 19:06:18 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:18 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:18 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:19 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.365s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f3ede03-f072-459c-85aa-537ac8726f32 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-d430cae0-2609-42d8-8b66-1460cce657a2-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:19 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88" returned: 0 in 1.164s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.954s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:06:19 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88 Jul 08 19:06:19 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:19 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 0 in 1.043s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:19 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD Jul 08 19:06:19 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:19 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.008s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:19 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Deleted volume successfully. Jul 08 19:06:19 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf7bef7-b20e-4705-bd88-d982d083eecf -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24" returned: 0 in 1.091s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 is being set with open permissions: ugo+rw Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-959ea899-db4e-4cbc-a549-3af701911123 tempest-CreateVolumesFromImageTest-2084419910 None] Lock "cinder-20840d64-5887-4827-969f-a957289d1ef5-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:19 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 Jul 08 19:06:19 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:19 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-52b98d84-2b92-43c0-b379-63798ce52f88" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-52b98d84-2b92-43c0-b379-63798ce52f88" released by "delete_volume" :: held 1.977s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['474b98c0-d60d-4e30-94bb-fdc22240cd58', 'c1425e6d-1e94-4061-8b5a-09fbb2660956', '4ff9d038-528d-4d1e-94dd-f35ad32a85e9', '66efb776-e792-46f2-b7b3-d78b4c58e382'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:20 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:20 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ace051-d3a4-4b7e-906f-17a4cad9717a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:20 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD" returned: 1 in 1.092s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] 13573b28-41f1-4529-8160-2ca00aefcb06 was raw, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:20 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:20 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:20 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 Jul 08 19:06:20 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:20 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24" returned: 0 in 0.927s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:20 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info Jul 08 19:06:20 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:21 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e56bc086-9cbf-4120-bfe4-29afe8dc8a39 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-52b98d84-2b92-43c0-b379-63798ce52f88-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:21 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 0 in 0.996s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13573b28-41f1-4529-8160-2ca00aefcb06_5arlclapdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:06:21 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:21 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1G Jul 08 19:06:21 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:21 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" returned: 0 in 1.297s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:21 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5 Jul 08 19:06:21 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:21 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info" returned: 0 in 0.977s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:21 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info is being set with open permissions: ugo+rw Jul 08 19:06:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:21 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info Jul 08 19:06:21 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:22 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 1G" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fab03c-5c85-4fe7-bed8-4ca4e0b6d466]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:22 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:22 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:22 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5" released by "delete_volume" :: held 2.156s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:22 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.info" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.307s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-fa144228-f026-4ce5-88c7-23dbdafe52d9 tempest-ProjectReaderTests-290467064 None] Create snapshot completed successfully Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['4ed9d572-9605-4811-bc15-8d334e828dd8', 'bbff2d6f-4773-4b06-a7e9-2267ef6805bb', 'e9bf87f1-a5e6-4c35-996e-d79e14d11694', 'b27f2e36-1111-49b1-be73-e3bd671d38b5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:22 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:22 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:23 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 0 in 0.894s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:23 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:23 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-ffefb7d3-b118-4714-93b2-aae4f1860f24-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-ffefb7d3-b118-4714-93b2-aae4f1860f24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-ffefb7d3-b118-4714-93b2-aae4f1860f24" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-ffefb7d3-b118-4714-93b2-aae4f1860f24" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Deleting offline snapshot ffefb7d3-b118-4714-93b2-aae4f1860f24 of volume faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] snapshot_file for this snap is: volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87bfb6-1b49-46eb-9447-b20b647733cc]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:23 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.791s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (83f85c11-1d5c-46dc-8b0f-39d77c367b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3230ccc9-7ee5-495f-a67c-a89d10319a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3230ccc9-7ee5-495f-a67c-a89d10319a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677876256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cc6c28-5791-4779-8455-c1eecf48a6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:23Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54100f89-2ae6-4264-ad6f-c1fca480b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54100f89-2ae6-4264-ad6f-c1fca480b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15ef87-a3bc-4f4e-acd8-5482b397b38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15ef87-a3bc-4f4e-acd8-5482b397b38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cc6c28-5791-4779-8455-c1eecf48a6f9', 'volume_name': 'volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82309b13-3581-491b-b297-a615e962382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:23 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 Jul 08 19:06:23 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82309b13-3581-491b-b297-a615e962382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ddb384-e92c-4599-92b1-c1d1881db345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:23 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume a3cc6c28-5791-4779-8455-c1eecf48a6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9', 'volume_size': 1} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677876256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cc6c28-5791-4779-8455-c1eecf48a6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:23Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:23 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-30723ee8-2579-45a8-b2c3-9265c7bd03c1-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9f732ac4-fee8-4ec8-a84c-1d032fd70fa6 tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-c56a9b5e-deb3-4963-b541-3e1d4a2d3ec5-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:23 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 1073741824 Jul 08 19:06:23 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-30723ee8-2579-45a8-b2c3-9265c7bd03c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-30723ee8-2579-45a8-b2c3-9265c7bd03c1" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-30723ee8-2579-45a8-b2c3-9265c7bd03c1" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34197e6-287e-49a2-bd4b-cda8b62e4ca9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:23 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 Jul 08 19:06:23 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:24 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 1 in 0.944s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Downloaded image 13573b28-41f1-4529-8160-2ca00aefcb06 ((None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}])) to volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Temporary image 13573b28-41f1-4529-8160-2ca00aefcb06 for user 206f3550ba464913977e0ea7301a603f is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Marking volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Copying metadata from image 13573b28-41f1-4529-8160-2ca00aefcb06 to 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Creating volume glance metadata for volume 65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 backed by image 13573b28-41f1-4529-8160-2ca00aefcb06 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7f9a2d972ba7bb455c49f03ca013391d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ef1714-bc71-42f1-8cbc-02402ff32dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01', 'volume_size': 1, 'image_id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13573b28-41f1-4529-8160-2ca00aefcb06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f9a2d972ba7bb455c49f03ca013391d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3a9ce9b289416181ac13cdd8ad9fda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fdb580c07af877d14e6eaf03c8e677378e9d89c68b86f8173da6f47ac0b7d1f725c4228fcb030297085949bde814223c8b5a0be090a63a90a674092de6eabf9e', 'id': '13573b28-41f1-4529-8160-2ca00aefcb06', 'created_at': datetime.datetime(2026, 7, 8, 17, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13573b28-41f1-4529-8160-2ca00aefcb06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af181e8-44dd-4140-80e5-14b1965ac666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:24 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Volume volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 (65ffa27e-16ef-4fc6-8d0c-50bda74e7e01): created successfully Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af181e8-44dd-4140-80e5-14b1965ac666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Flow 'volume_create_manager' (2b39392f-eb69-4a8f-95a8-83c9028f0a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:24 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9d476dc9-6b66-4067-8373-a7b9f3dbbab6 tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Created volume successfully. Jul 08 19:06:24 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24" returned: 0 in 1.018s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf7bef7-b20e-4705-bd88-d982d083eecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ca440-927a-4b65-b3fe-27bf213fde2d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:24 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf Jul 08 19:06:24 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:24 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 1073741824" returned: 0 in 0.971s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:24 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 Jul 08 19:06:24 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:24 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1" returned: 0 in 0.927s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:24 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1 Jul 08 19:06:24 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Acquiring lock "cinder-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "cinder-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Acquiring lock "cinder-quobyte-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "cinder-quobyte-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02364e2f-fffb-40dc-97d8-0119883ddec0]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:25 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:25 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:25 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf" returned: 0 in 0.853s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:25 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 Jul 08 19:06:25 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:25 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9" returned: 0 in 0.745s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ddb384-e92c-4599-92b1-c1d1881db345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb6e9ce-e37e-4970-9a09-86b00a6b769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 (a3cc6c28-5791-4779-8455-c1eecf48a6f9): created successfully Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb6e9ce-e37e-4970-9a09-86b00a6b769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (83f85c11-1d5c-46dc-8b0f-39d77c367b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-032e38d2-3462-4aad-bb32-7230d5b52349 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:25 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-30723ee8-2579-45a8-b2c3-9265c7bd03c1" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-30723ee8-2579-45a8-b2c3-9265c7bd03c1" released by "delete_volume" :: held 1.777s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['c05fdeba-c92a-4340-a5a4-ab9cabe58952', '0fab8264-a0f7-427d-807d-28b9309a3379', '7947aff3-8148-43b6-a938-88da1e21e235', '004e6785-c18c-4d3c-abc6-5fac8d348732'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:25 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:25 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating offline snapshot b18f82d7-8a9c-4503-a11d-bb5085a49b43 of volume a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6adeea5-6ea3-418c-8657-f5fb4ceefec4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:25 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 0 in 0.920s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:26 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 Jul 08 19:06:26 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-695335c5-0440-4ad4-aaa7-cf97a82bc34c-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-695335c5-0440-4ad4-aaa7-cf97a82bc34c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:26 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:26 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-695335c5-0440-4ad4-aaa7-cf97a82bc34c" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-695335c5-0440-4ad4-aaa7-cf97a82bc34c" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a2ed6-b536-46c0-b64a-6e2192a919a5]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:26 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24" returned: 0 in 0.950s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:26 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24 Jul 08 19:06:26 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:26 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c Jul 08 19:06:26 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:26 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.021s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:26 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-6bd5089b-5162-4902-8302-fca9359d28df tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-30723ee8-2579-45a8-b2c3-9265c7bd03c1-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:26 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9" returned: 0 in 1.126s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:27 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 1 in 1.075s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:27 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 1G Jul 08 19:06:27 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:27 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01 Jul 08 19:06:27 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:27 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:27 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf.ffefb7d3-b118-4714-93b2-aae4f1860f24" returned: 0 in 0.839s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c" returned: 0 in 0.950s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-ffefb7d3-b118-4714-93b2-aae4f1860f24" released by "_delete_snapshot" :: held 3.791s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" released by "delete_snapshot" :: held 3.824s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:27 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c Jul 08 19:06:27 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Created reservations ['22450d5c-6afc-4306-8e92-f8e7a359506b', '026036d2-20a7-4e72-916c-fc82279812c3', '8be5f09c-3910-42ab-9b4d-d728603b6d86', 'c10fcafb-250f-45e1-af2c-14d76a2cd7c1'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Delete snapshot completed successfully. Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a4f4646-428b-4b68-a5db-6ab2c51b8c42 tempest-ProjectReaderTests-290467064 None] Lock "cinder-ffefb7d3-b118-4714-93b2-aae4f1860f24-delete_snapshot" released by "delete_snapshot" :: held 4.015s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-faf7bef7-b20e-4705-bd88-d982d083eecf-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "cinder-faf7bef7-b20e-4705-bd88-d982d083eecf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b10304-291b-4463-800e-79a32066f627]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:27 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "cinder-quobyte-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01" released by "delete_volume" :: held 2.891s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Created reservations ['d4765d14-87e5-4cff-916d-5979f1597715', 'b5760e67-e505-4e4e-b128-a22c7fcc68cc', 'dfa6150a-fe31-4d49-8f37-147385047911', 'b66ab3ea-66cc-4e94-b65e-e7b1100ea62e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:27 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf Jul 08 19:06:27 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:27 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-695335c5-0440-4ad4-aaa7-cf97a82bc34c" returned: 0 in 0.806s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:27 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-695335c5-0440-4ad4-aaa7-cf97a82bc34c" released by "delete_volume" :: held 1.801s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:27 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 1G" returned: 0 in 1.015s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:28 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 Jul 08 19:06:28 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:28 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:28 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['704e234f-8946-49f6-b379-e221506aabe0', 'c118b31c-39e2-4b90-b4dd-3fd604b4c243', 'c5b55158-5b01-46b5-aabb-cbbd773ba18e', 'a7431734-e034-4a88-8938-b565a2ca48a5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:28 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:28 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "cinder-quobyte-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23189d-11ef-4feb-becf-08117076bf06]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:28 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 Jul 08 19:06:28 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:29 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.988s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:29 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Deleted volume successfully. Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43" returned: 0 in 1.059s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 is being set with open permissions: ugo+rw Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-3a0c5879-d304-48b9-945c-1af0ee711c5e tempest-VolumeAndVolumeTypeFromImageTest-798811537 None] Lock "cinder-65ffa27e-16ef-4fc6-8d0c-50bda74e7e01-delete_volume" released by "delete_volume" :: held 4.227s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:29 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 Jul 08 19:06:29 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:29 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf" returned: 0 in 1.379s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:29 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf Jul 08 19:06:29 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:29 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.166s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:29 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c57e5af5-ed87-47e0-b2f4-dee4bf45fc3e tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-695335c5-0440-4ad4-aaa7-cf97a82bc34c-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:29 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" returned: 0 in 1.100s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:29 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92 Jul 08 19:06:29 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:29 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:29 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-faf7bef7-b20e-4705-bd88-d982d083eecf" returned: 0 in 0.854s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-faf7bef7-b20e-4705-bd88-d982d083eecf" released by "delete_volume" :: held 2.295s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:30 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info Jul 08 19:06:30 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Created reservations ['7d51e273-7367-440e-9c54-285079273f99', 'b89f03ca-d553-4991-bb8c-dc5638f2e2be', 'd35e8740-1dbb-412f-b10d-0b0efb95d696', '4c4d0b45-3dfa-4e1c-9860-503eddef477a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:30 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:30 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:30 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-quobyte-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92" released by "delete_volume" :: held 1.961s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Created reservations ['eea714c1-ce4e-4474-8ef2-41fe0dd227aa', 'c445cbd3-dd0f-4359-8c26-48c207b67c4a', '3684708e-1a98-453d-8c6a-a2a3631d5a00', 'ef15d860-6ee3-4eff-abda-6ac4a793d765'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:30 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:30 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:30 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info" returned: 0 in 0.902s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:30 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info is being set with open permissions: ugo+rw Jul 08 19:06:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:30 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info Jul 08 19:06:30 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:31 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.994s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Deleted volume successfully. Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8045f787-4132-4e03-a322-f562cddaff6b tempest-ProjectReaderTests-290467064 None] Lock "cinder-faf7bef7-b20e-4705-bd88-d982d083eecf-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:31 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (884c1a9a-6eae-4c88-9a3b-20ec918b5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae0c349-5022-4af1-bb56-3916d60210c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.info" returned: 0 in 1.028s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:32 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.210s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.277s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae0c349-5022-4af1-bb56-3916d60210c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879278985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c171e6c5-5b02-4fd2-b4ab-3747ef65c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:32Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcc2df4-7ce9-407c-a5bb-525cc369735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcc2df4-7ce9-407c-a5bb-525cc369735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f509634-429d-4dc2-9e5b-b46abcf64533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f509634-429d-4dc2-9e5b-b46abcf64533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c171e6c5-5b02-4fd2-b4ab-3747ef65c78e', 'volume_name': 'volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c00b58d-01ef-47e5-a638-726091af7b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c00b58d-01ef-47e5-a638-726091af7b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7677a369-2f79-4540-9d80-28178bcd90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:32 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Volume c171e6c5-5b02-4fd2-b4ab-3747ef65c78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e', 'volume_size': 1} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879278985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c171e6c5-5b02-4fd2-b4ab-3747ef65c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:32Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Creating volume c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:32 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Deleted volume successfully. Jul 08 19:06:32 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e 1073741824 Jul 08 19:06:32 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5869857a-37a7-4c51-bfc1-cc0c62ab256e tempest-CreateVolumesFromSnapshotTest-329003579 None] Create snapshot completed successfully Jul 08 19:06:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c70c47bd-d067-4f58-a288-9752c16bc12d tempest-CreateVolumesFromSourceVolumeTest-1207666902 None] Lock "cinder-bfd3d0b9-1b3f-4672-aa5c-8f29fb82aa92-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:33 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e 1073741824" returned: 0 in 0.968s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:33 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e Jul 08 19:06:33 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (864cba11-3698-46eb-ae8a-ac6663bbeb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b256730-22e0-460c-8ed9-2b737419a022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b256730-22e0-460c-8ed9-2b737419a022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204071306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:34Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f393d-f907-4b16-b05e-d22c4bf129a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596f393d-f907-4b16-b05e-d22c4bf129a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf661b9-5f73-490a-8461-a53a8c0e5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf661b9-5f73-490a-8461-a53a8c0e5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3', 'volume_name': 'volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920478bf-ab34-4823-8290-9680d39dc1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920478bf-ab34-4823-8290-9680d39dc1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4944dd8b-c8e2-4c59-b0bc-68669c71be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:33 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3', 'volume_size': 1} Jul 08 19:06:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:34 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" returned: 0 in 0.956s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204071306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:34Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:34 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:34 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 1073741824 Jul 08 19:06:34 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7677a369-2f79-4540-9d80-28178bcd90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02fc287-34db-4d67-a528-5e4d4ccab17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Volume volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e (c171e6c5-5b02-4fd2-b4ab-3747ef65c78e): created successfully Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02fc287-34db-4d67-a528-5e4d4ccab17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (884c1a9a-6eae-4c88-9a3b-20ec918b5f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e6c9d068-5309-4e73-9604-a92b9ab40ad1 tempest-ProjectReaderTests-290467064 None] Created volume successfully. Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (5ef9fca4-002f-4797-ac37-fca8e100feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08246ba-59b8-4657-96d8-c9ebd7eea075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08246ba-59b8-4657-96d8-c9ebd7eea075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966742372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:34Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d765a5a4-f275-4771-bc92-65d24e249f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d765a5a4-f275-4771-bc92-65d24e249f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b379d4e-30cc-4119-9cf8-fd43ed00827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b379d4e-30cc-4119-9cf8-fd43ed00827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3', 'volume_name': 'volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bba0a4-b515-4aad-a920-0f3180b61380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bba0a4-b515-4aad-a920-0f3180b61380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a56d478-625e-4f4e-ad8b-e5905ec9e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume 2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3', 'volume_size': 1} Jul 08 19:06:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:35 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 1073741824" returned: 0 in 1.174s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:35 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 Jul 08 19:06:35 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Flow 'volume_create_manager' (9e1bb880-6088-42fb-94f8-a647e4a04bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d54c5-bba4-42e3-99fa-8ccba9e82be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d54c5-bba4-42e3-99fa-8ccba9e82be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1789072704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773132b9-5f6c-44d3-af7b-33a037dbea3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d4862a466404daa911b29bdd1a79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:35Z,use_quota=True,user_id='aa6cbe6a928f4011bf6463ee4b262ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af14e03-2afe-420b-afb0-fe0ff82c7729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af14e03-2afe-420b-afb0-fe0ff82c7729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81ae85a-ba73-4a02-8ff6-96536a2953b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81ae85a-ba73-4a02-8ff6-96536a2953b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773132b9-5f6c-44d3-af7b-33a037dbea3d', 'volume_name': 'volume-773132b9-5f6c-44d3-af7b-33a037dbea3d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7a0218-5a2c-468d-bac9-8ca6c059c9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7a0218-5a2c-468d-bac9-8ca6c059c9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0f9def-3ef2-4a7a-880a-286aa809763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Volume 773132b9-5f6c-44d3-af7b-33a037dbea3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773132b9-5f6c-44d3-af7b-33a037dbea3d', 'volume_size': 1} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (1b5c284d-1857-402f-86e1-4907cd709c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d56d96-cbab-46cc-844b-87b543be28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d56d96-cbab-46cc-844b-87b543be28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774096819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eb42bf-d93c-4a7e-8707-da52a8b3ad55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e813cce0-c78d-4d8d-b4c4-7fdb28ba394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e813cce0-c78d-4d8d-b4c4-7fdb28ba394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e615ad-58f7-41d5-b0e7-188869273931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e615ad-58f7-41d5-b0e7-188869273931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94eb42bf-d93c-4a7e-8707-da52a8b3ad55', 'volume_name': 'volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5e607a-b119-4c96-be50-f375dfe6d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5e607a-b119-4c96-be50-f375dfe6d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9825b128-2524-4980-8b3d-c71529b60aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume 94eb42bf-d93c-4a7e-8707-da52a8b3ad55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55', 'volume_size': 1} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (4369252b-5aae-4472-a290-103e257031dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5557f26c-19d1-4878-a631-0cfae3769fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5557f26c-19d1-4878-a631-0cfae3769fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636797008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0205ec01-8ddd-43ab-a700-bc2f3cdb6b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0402b-1db0-4cb2-aa83-cb40677e6fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0402b-1db0-4cb2-aa83-cb40677e6fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6692125-a957-49a5-962a-f48fe37424e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6692125-a957-49a5-962a-f48fe37424e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0205ec01-8ddd-43ab-a700-bc2f3cdb6b68', 'volume_name': 'volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c71097e-5618-4a51-b0da-09b87b6f5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c71097e-5618-4a51-b0da-09b87b6f5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36720a03-8fd2-4f54-aba1-af7f1ce5ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume 0205ec01-8ddd-43ab-a700-bc2f3cdb6b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68', 'volume_size': 1} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (2737c530-631b-4040-9123-c632e9eec16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d427a-e343-40b5-b3fb-be6778d323bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1d427a-e343-40b5-b3fb-be6778d323bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620824926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc2578-4a00-4464-945c-b142f246cd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a07862-47dd-46f5-a8fa-f2b3764dca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a07862-47dd-46f5-a8fa-f2b3764dca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00d2e07-f148-410f-8748-7d25b0a8ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00d2e07-f148-410f-8748-7d25b0a8ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39cc2578-4a00-4464-945c-b142f246cd4e', 'volume_name': 'volume-39cc2578-4a00-4464-945c-b142f246cd4e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b57e2f-93dc-4085-8852-d26d1f3bfca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b57e2f-93dc-4085-8852-d26d1f3bfca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cd5142-b208-4dcd-8026-4306ab5d9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume 39cc2578-4a00-4464-945c-b142f246cd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39cc2578-4a00-4464-945c-b142f246cd4e', 'volume_size': 1} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" returned: 0 in 0.907s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966742372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:34Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume 2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:36 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:36 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 1073741824 Jul 08 19:06:36 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4944dd8b-c8e2-4c59-b0bc-68669c71be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388b805a-04e2-495c-8fe7-e519717febab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 (da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3): created successfully Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388b805a-04e2-495c-8fe7-e519717febab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (864cba11-3698-46eb-ae8a-ac6663bbeb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e5340541-4437-4b83-a392-bbfc6d489b3e tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:37 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 1073741824" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:37 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 Jul 08 19:06:37 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:37 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" returned: 0 in 0.675s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1789072704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773132b9-5f6c-44d3-af7b-33a037dbea3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d4862a466404daa911b29bdd1a79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:35Z,use_quota=True,user_id='aa6cbe6a928f4011bf6463ee4b262ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Creating volume 773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:37 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a56d478-625e-4f4e-ad8b-e5905ec9e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:37 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d 1073741824 Jul 08 19:06:37 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dab03b-e52a-425e-b7bd-03d461ae4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:37 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 (2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3): created successfully Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dab03b-e52a-425e-b7bd-03d461ae4f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:37 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (5ef9fca4-002f-4797-ac37-fca8e100feaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:37 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-14b0670b-e2ea-4023-b5ce-a7a6436cf184 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Flow 'volume_create_manager' (7ee1afa9-6cc4-4e43-b38f-cbdeaab4677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72101554-7fab-4669-915e-394ce960024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72101554-7fab-4669-915e-394ce960024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450ba672-b9dd-4704-8b00-2b04d767e905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803285a789848508b2cc1ac9e88f2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:39Z,use_quota=True,user_id='0700d9e590d344d3b76569f583325739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d39a0-d12e-40a6-a3ef-f583895988d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d39a0-d12e-40a6-a3ef-f583895988d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0f7acd-dd39-482a-b691-b12e617c13da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.image.glance [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Creating Keystone auth plugin from conf {{(pid=87229) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:06:38 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d 1073741824" returned: 0 in 0.876s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:38 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:06:38 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0f7acd-dd39-482a-b691-b12e617c13da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '450ba672-b9dd-4704-8b00-2b04d767e905', 'volume_name': 'volume-450ba672-b9dd-4704-8b00-2b04d767e905', 'volume_size': 1, 'image_id': '8cf76993-c51d-46eb-903b-c51338726200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88a636d472bf1cdbf46baf1bf075a2af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9803285a789848508b2cc1ac9e88f2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9e17c52be343b399588dc2da6f996e37cd0ead3f67c4d6c469bb6230f99629ee30e6d57537f8734abd49d3143e45774f099d15b0a3ee790e342c4f3e4156639', 'id': '8cf76993-c51d-46eb-903b-c51338726200', 'created_at': datetime.datetime(2026, 7, 8, 17, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cf76993-c51d-46eb-903b-c51338726200/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fa8430-825a-4386-9d8e-26d2a66cddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fa8430-825a-4386-9d8e-26d2a66cddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196040d8-f65f-4ada-bd72-8ffc662d1404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:38 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Volume 450ba672-b9dd-4704-8b00-2b04d767e905: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-450ba672-b9dd-4704-8b00-2b04d767e905', 'volume_size': 1, 'image_id': '8cf76993-c51d-46eb-903b-c51338726200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88a636d472bf1cdbf46baf1bf075a2af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9803285a789848508b2cc1ac9e88f2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9e17c52be343b399588dc2da6f996e37cd0ead3f67c4d6c469bb6230f99629ee30e6d57537f8734abd49d3143e45774f099d15b0a3ee790e342c4f3e4156639', 'id': '8cf76993-c51d-46eb-903b-c51338726200', 'created_at': datetime.datetime(2026, 7, 8, 17, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cf76993-c51d-46eb-903b-c51338726200/file', 'properties': {}}, 'image_service': } Jul 08 19:06:38 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Trying to clone 450ba672-b9dd-4704-8b00-2b04d767e905 from image 8cf76993-c51d-46eb-903b-c51338726200 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}]). {{(pid=87229) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 19:06:39 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f0248-065f-4aea-972e-7b83aca01f11]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:39 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:39 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:39 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.699s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0f9def-3ef2-4a7a-880a-286aa809763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773132b9-5f6c-44d3-af7b-33a037dbea3d', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f45649-e764-47e2-a3d2-ce31b4d6f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Creating offline snapshot 31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 of volume c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:06:39 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Volume volume-773132b9-5f6c-44d3-af7b-33a037dbea3d (773132b9-5f6c-44d3-af7b-33a037dbea3d): created successfully Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f45649-e764-47e2-a3d2-ce31b4d6f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Flow 'volume_create_manager' (9e1bb880-6088-42fb-94f8-a647e4a04bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905fbd7-adf1-4acb-b36e-74216e50ecf6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2419db41-82ae-4a46-9e30-4e3933234128 tempest-VolumeDependencyTests-8951478 None] Created volume successfully. Jul 08 19:06:39 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e Jul 08 19:06:39 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:39 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 0 in 0.864s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:40 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:40 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:40 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:40 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 1G Jul 08 19:06:40 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:40 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 1 in 0.814s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Temporary image 8cf76993-c51d-46eb-903b-c51338726200 is fetched for user 0700d9e590d344d3b76569f583325739. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d8cd4-0ce3-4c0d-8a58-2d4bc4761bff]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:40 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:40 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:41 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 1G" returned: 0 in 0.883s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:41 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 Jul 08 19:06:41 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:41 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:41 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:41 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:42 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" returned: 0 in 0.723s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:42 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 is being set with open permissions: ugo+rw Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:42 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 Jul 08 19:06:42 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:42 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 1 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:42 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:42 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info Jul 08 19:06:42 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:43 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info" returned: 0 in 0.637s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:43 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info is being set with open permissions: ugo+rw Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:43 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info Jul 08 19:06:43 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:43 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.info" returned: 0 in 0.638s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.049s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774096819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eb42bf-d93c-4a7e-8707-da52a8b3ad55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume 94eb42bf-d93c-4a7e-8707-da52a8b3ad55 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:44 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 1073741824 Jul 08 19:06:44 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3708a24e-d83a-42b7-a793-9cc28afafe0a tempest-ProjectReaderTests-290467064 None] Create snapshot completed successfully Jul 08 19:06:44 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 1073741824" returned: 0 in 0.886s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:44 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 Jul 08 19:06:44 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Deleting offline snapshot 31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 of volume c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] snapshot_file for this snap is: volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6900145-cdb8-4f9e-b5a3-83c9c28828dd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:45 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 Jul 08 19:06:45 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:45 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.603s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636797008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0205ec01-8ddd-43ab-a700-bc2f3cdb6b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume 0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:45 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:45 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 1073741824 Jul 08 19:06:45 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9825b128-2524-4980-8b3d-c71529b60aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8321021-72da-4508-aa36-a486c4055bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:45 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 (94eb42bf-d93c-4a7e-8707-da52a8b3ad55): created successfully Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8321021-72da-4508-aa36-a486c4055bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (1b5c284d-1857-402f-86e1-4907cd709c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b19e2c66-28ea-4481-83e3-d4ad5ae5f7d5 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:45 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" returned: 0 in 0.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1511969a-e6e1-4f2d-9727-2db078731e7e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:45 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e Jul 08 19:06:45 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:46 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 1073741824" returned: 0 in 0.853s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:46 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 Jul 08 19:06:46 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:46 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" returned: 0 in 0.846s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:46 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 Jul 08 19:06:46 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:47 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.020s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-620824926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39cc2578-4a00-4464-945c-b142f246cd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13fc7b412d24e5d8186e360f5eab8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:36Z,use_quota=True,user_id='495663d5b1dc4d3184e1f4081c06469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Creating volume 39cc2578-4a00-4464-945c-b142f246cd4e {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:47 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36720a03-8fd2-4f54-aba1-af7f1ce5ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:47 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e 1073741824 Jul 08 19:06:47 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed7dcb5-5e39-4a7c-a803-894c7cde73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:47 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 (0205ec01-8ddd-43ab-a700-bc2f3cdb6b68): created successfully Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed7dcb5-5e39-4a7c-a803-894c7cde73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (4369252b-5aae-4472-a290-103e257031dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8989e652-32cf-4552-928a-9ae1cf5110d2 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:47 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:47 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0 Jul 08 19:06:47 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:48 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e 1073741824" returned: 0 in 0.852s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:48 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e Jul 08 19:06:48 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:48 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e.31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" returned: 0 in 0.745s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0" released by "_delete_snapshot" :: held 3.323s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" released by "delete_snapshot" :: held 3.351s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Created reservations ['3fe40e10-e2f4-4cc7-b992-2e0f2b2a9788', 'f13cfabb-7648-4c3b-be5e-5c49f73646c9', 'e584ddf9-67bf-4913-b609-81b2f5c11682', '5bd70860-eb94-40d8-8283-5e50d4dd5b5a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Delete snapshot completed successfully. Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-dc2d500e-224e-4597-b7f7-84853dcc7878 tempest-ProjectReaderTests-290467064 None] Lock "cinder-31a83f91-6f2a-4d26-8f6e-87ab8245bbd0-delete_snapshot" released by "delete_snapshot" :: held 3.518s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:48 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e" returned: 0 in 0.700s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.300s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Creating offline snapshot 0bcc8338-aa1c-4c63-91c4-be6b560c667f of volume 773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cd5142-b208-4dcd-8026-4306ab5d9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39cc2578-4a00-4464-945c-b142f246cd4e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30f4c51-f37e-4369-afee-8f54a6357618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3354793-abfd-48a3-bcbc-ccc82453758b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Volume volume-39cc2578-4a00-4464-945c-b142f246cd4e (39cc2578-4a00-4464-945c-b142f246cd4e): created successfully Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30f4c51-f37e-4369-afee-8f54a6357618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Flow 'volume_create_manager' (2737c530-631b-4040-9123-c632e9eec16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:48 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0d32b2b4-b89f-4d2c-bc37-88fceea2197c tempest-CreateVolumesFromSnapshotTest-329003579 None] Created volume successfully. Jul 08 19:06:48 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:06:48 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "cinder-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-39cc2578-4a00-4464-945c-b142f246cd4e-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" acquired by "delete_volume" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-39cc2578-4a00-4464-945c-b142f246cd4e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd0730b-bbd1-4396-9695-69a54dc08724]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-39cc2578-4a00-4464-945c-b142f246cd4e" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-39cc2578-4a00-4464-945c-b142f246cd4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266b843-94a2-4072-b1a3-8f3f3914c6fd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:49 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e Jul 08 19:06:49 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:49 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e Jul 08 19:06:49 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:49 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 0.860s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:49 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f 1G Jul 08 19:06:49 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:50 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" returned: 0 in 0.832s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:50 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e Jul 08 19:06:50 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:50 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e" returned: 0 in 0.815s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:50 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e Jul 08 19:06:50 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:50 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f 1G" returned: 0 in 0.889s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773132b9-5f6c-44d3-af7b-33a037dbea3d -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:50 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773132b9-5f6c-44d3-af7b-33a037dbea3d -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:06:50 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:50 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" returned: 0 in 0.708s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e" released by "delete_volume" :: held 1.615s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Created reservations ['e5cbd421-9bfa-4fc1-8019-0ab1a8e7fb4d', 'b0cf40f2-6884-4d81-907c-a6c761d802ab', 'a57cc776-671e-4b16-94ad-dac2df40be3e', 'c3d2fc8c-9570-4671-bf96-0d33230a0a1f'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:50 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-39cc2578-4a00-4464-945c-b142f246cd4e" returned: 0 in 0.746s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-39cc2578-4a00-4464-945c-b142f246cd4e" released by "delete_volume" :: held 1.608s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:50 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=200,cinder:SELECT=152,cinder:INSERT=44,cinder:DELETE=16 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:51 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:51 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['9b553d2d-3d60-4531-9f65-6190fbf0dffc', '689e3740-4a7c-440b-8b8b-0ad2ddcc8308', 'e1bd6b11-1197-4b98-acb9-9b42afa4c704', '81d8a829-cb84-4753-9d85-0b4df01bdbf6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:51 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:51 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:51 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-773132b9-5f6c-44d3-af7b-33a037dbea3d -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 0.838s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:51 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f is being set with open permissions: ugo+rw Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:51 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:06:51 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=135,cinder:UPDATE=195,cinder:DELETE=21,cinder:INSERT=56 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4540fc-e82f-49f8-8165-5c1e14a68896]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:52 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 Jul 08 19:06:52 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:52 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.023s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Deleted volume successfully. Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a6825925-9422-47d4-a040-7d19d33a36e1 tempest-ProjectReaderTests-290467064 None] Lock "cinder-c171e6c5-5b02-4fd2-b4ab-3747ef65c78e-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:52 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.041s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (7cf8beea-78bd-469e-9a96-7c775ec5dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e2bc3b-701b-4f1e-af13-9ad7ba150970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e2bc3b-701b-4f1e-af13-9ad7ba150970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874999643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2104e7-8e7b-4103-972a-888938b0d8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:52Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3d84cb-7447-46d9-912f-e72ac185e04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3d84cb-7447-46d9-912f-e72ac185e04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a1ee3-159b-4401-85ad-ade0c9f4689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a1ee3-159b-4401-85ad-ade0c9f4689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2104e7-8e7b-4103-972a-888938b0d8e6', 'volume_name': 'volume-8f2104e7-8e7b-4103-972a-888938b0d8e6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729c2d77-a389-4bde-9f71-69bebda6175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729c2d77-a389-4bde-9f71-69bebda6175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d42ccc8-d0e5-476f-b538-fdb5f7b54eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Volume 8f2104e7-8e7b-4103-972a-888938b0d8e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2104e7-8e7b-4103-972a-888938b0d8e6', 'volume_size': 1} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a90e339e-a087-42c3-8184-eb285053d927 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-39cc2578-4a00-4464-945c-b142f246cd4e-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:52 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:52 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info Jul 08 19:06:52 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:52 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:52 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68 Jul 08 19:06:52 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:53 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info" returned: 0 in 0.730s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:53 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info is being set with open permissions: ugo+rw Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:53 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info Jul 08 19:06:53 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:53 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68" released by "delete_volume" :: held 1.723s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['00c62628-3da1-4c95-909c-570a6e7d4dbd', 'a4797427-0d2b-4b20-87e5-77a40758fc14', '5ba79b76-c662-47ae-aedc-89f5db42b963', '4f1ff7c5-97a1-4dec-a409-d7f7b011a03a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:53 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:53 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:53 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.info" returned: 0 in 0.730s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.992s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.480s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450ba672-b9dd-4704-8b00-2b04d767e905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9803285a789848508b2cc1ac9e88f2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:39Z,use_quota=True,user_id='0700d9e590d344d3b76569f583325739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Creating volume 450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:53 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-94eb42bf-d93c-4a7e-8707-da52a8b3ad55-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:53 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1073741824 Jul 08 19:06:53 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-94eb42bf-d93c-4a7e-8707-da52a8b3ad55-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-29729204-5444-4a43-aed0-cacb73c9d79d tempest-VolumeDependencyTests-8951478 None] Create snapshot completed successfully Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:53 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f4e33-854b-437f-8ea9-fbe576c622d7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:54 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 Jul 08 19:06:54 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:54 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.035s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2b8742dc-3cf3-4f77-8270-c07188799fc0 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-0205ec01-8ddd-43ab-a700-bc2f3cdb6b68-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Flow 'volume_create_manager' (69baf756-dd85-4514-ac91-fc013204bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb66e24d-dfa4-41bf-9ca6-9e7217e7e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb66e24d-dfa4-41bf-9ca6-9e7217e7e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1283783422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9553a58-9128-4360-8b23-f2608eda559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d4862a466404daa911b29bdd1a79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bcc8338-aa1c-4c63-91c4-be6b560c667f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:55Z,use_quota=True,user_id='aa6cbe6a928f4011bf6463ee4b262ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c5db65-f6fb-4443-a858-ddd8051c8133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c5db65-f6fb-4443-a858-ddd8051c8133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072e2c0f-6fdc-42b1-9b01-35fed8c0af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072e2c0f-6fdc-42b1-9b01-35fed8c0af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9553a58-9128-4360-8b23-f2608eda559a', 'volume_name': 'volume-a9553a58-9128-4360-8b23-f2608eda559a', 'volume_size': 1, 'snapshot_id': '0bcc8338-aa1c-4c63-91c4-be6b560c667f'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d13f684-966d-40a4-9c5a-75a848188cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d13f684-966d-40a4-9c5a-75a848188cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe5de83-e9f4-4c2c-87a4-e3da8c70413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:55 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Volume a9553a58-9128-4360-8b23-f2608eda559a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9553a58-9128-4360-8b23-f2608eda559a', 'volume_size': 1, 'snapshot_id': '0bcc8338-aa1c-4c63-91c4-be6b560c667f'} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:55 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1073741824" returned: 0 in 1.181s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:55 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" returned: 0 in 1.047s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:55 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:06:55 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:55 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55 Jul 08 19:06:55 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:55 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:55 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.454s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874999643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2104e7-8e7b-4103-972a-888938b0d8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:06:52Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Creating volume 8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:55 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" returned: 0 in 0.698s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:55 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 1073741824 Jul 08 19:06:55 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-94eb42bf-d93c-4a7e-8707-da52a8b3ad55" released by "delete_volume" :: held 1.814s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Attempting download of 8cf76993-c51d-46eb-903b-c51338726200 ((None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}])) to volume 450ba672-b9dd-4704-8b00-2b04d767e905. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['a2416ffe-c1e2-4947-a411-33ea6d1fa1ea', '3d8f5a03-a056-4f6e-a57e-b015963c5dd1', '355dd704-303e-465f-9c73-ec242b7ffc41', '7b5187d0-720b-4c81-be94-d499d40fd968'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:55 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:55 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1235d-1c2e-4074-869d-effdb5cfe355]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:56 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q Jul 08 19:06:56 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22064925-1af7-4de9-95da-f7e0a74dcec9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:56 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 Jul 08 19:06:56 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:56 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 1073741824" returned: 0 in 1.039s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:56 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.883s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:56 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0f8fec49-f854-4ef3-b616-3388c2afe965 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-94eb42bf-d93c-4a7e-8707-da52a8b3ad55-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:56 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 Jul 08 19:06:56 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:56 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q" returned: 0 in 0.963s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:57 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q Jul 08 19:06:57 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:57 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" returned: 0 in 0.895s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:57 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3 Jul 08 19:06:57 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:57 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6" returned: 0 in 0.714s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.572s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f-a9553a58-9128-4360-8b23-f2608eda559a" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d42ccc8-d0e5-476f-b538-fdb5f7b54eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2104e7-8e7b-4103-972a-888938b0d8e6', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d774fb2e-9c3e-4e29-a4b1-2660e50e3534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f-a9553a58-9128-4360-8b23-f2608eda559a" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Creating volume a9553a58-9128-4360-8b23-f2608eda559a from snapshot 0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Volume volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 (8f2104e7-8e7b-4103-972a-888938b0d8e6): created successfully Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d774fb2e-9c3e-4e29-a4b1-2660e50e3534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (7cf8beea-78bd-469e-9a96-7c775ec5dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] snapshot: 0bcc8338-aa1c-4c63-91c4-be6b560c667f, volume: a9553a58-9128-4360-8b23-f2608eda559a, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1f91d939-0c0c-41c4-bbf3-0ebc66999d7f tempest-ProjectReaderTests-290467064 None] Created volume successfully. Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e3426-61df-464c-b8c6-4cddce135d00]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:57 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q" returned: 1 in 0.787s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8cf76993-c51d-46eb-903b-c51338726200_mlkb8x1q' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f801cf36-f57b-453b-acbb-4a1d2641c053]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:57 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:06:57 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:57 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:57 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:57 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" returned: 0 in 0.738s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3" released by "delete_volume" :: held 1.705s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['462e18d1-2c8c-4b1d-8d00-8a2af347d2f5', '1cab8014-f29a-4d73-9cd0-cc0c19898c04', '72807255-07a1-4242-a5ca-d09364454f79', '1019285d-349c-4ecd-b5e3-14ca2926de87'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:58 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:06:58 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61078f4d-9e30-4c4d-8612-178aaf1eca82]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:58 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:58 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 Jul 08 19:06:58 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:58 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 1.028s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:58 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773132b9-5f6c-44d3-af7b-33a037dbea3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:06:58 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66cddae-d042-466b-90b8-f7bde753aced]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:06:58 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:06:58 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:59 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:06:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c1d13d35-220c-4911-83fe-bd1f4e9e8bd9 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-2dbebe1d-46d9-4a9d-9b54-0af69ad9f4c3-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:06:59 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" returned: 0 in 0.918s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:59 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3 Jul 08 19:06:59 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:59 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD" returned: 1 in 0.915s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] 8cf76993-c51d-46eb-903b-c51338726200 was raw, converting to raw {{(pid=87229) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:59 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:06:59 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:06:59 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 0.872s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 19:06:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:06:59 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a Jul 08 19:06:59 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:00 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" returned: 0 in 0.704s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3" released by "delete_volume" :: held 1.670s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['4ce9d45c-bf6f-43ce-bf9f-5c3e5677a22e', 'dc60a299-5aeb-49b2-aeb8-5fdd9e193312', '5d3766b1-54a0-4292-98c1-2ed2591ba328', '2b063e2a-3e63-4ed2-a5a0-51f0bd53377e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:00 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8cf76993-c51d-46eb-903b-c51338726200_03s1qmv5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:07:00 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:00 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1G Jul 08 19:07:00 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:00 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:00 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-b18f82d7-8a9c-4503-a11d-bb5085a49b43-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-b18f82d7-8a9c-4503-a11d-bb5085a49b43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-b18f82d7-8a9c-4503-a11d-bb5085a49b43" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-b18f82d7-8a9c-4503-a11d-bb5085a49b43" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleting offline snapshot b18f82d7-8a9c-4503-a11d-bb5085a49b43 of volume a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] snapshot_file for this snap is: volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0975e-8ba5-41b3-a4b0-8b15d08a59f7]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:01 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 Jul 08 19:07:01 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:01 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.337s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:01 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:07:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ae3e7369-d503-4476-a6f9-f26f7cb1ff7c tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-da3cdcb5-ae2f-42e4-8a84-55f8ea0a7be3-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:02 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 1G" returned: 0 in 1.995s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ebdcc-22e0-4abc-aaf7-187d855c4a8e]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:02 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43" returned: 0 in 1.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:02 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:07:02 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4df78-a6d4-48d3-8ec3-35e81235f03c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:03 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 Jul 08 19:07:03 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:04 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 0 in 1.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:04 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:07:04 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:04 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9" returned: 0 in 1.976s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:04 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 Jul 08 19:07:04 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:05 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a" returned: 0 in 5.833s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f329d71-db36-497a-bb7b-efa621ee6368]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:05 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:07:05 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:05 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 1 in 1.504s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Downloaded image 8cf76993-c51d-46eb-903b-c51338726200 ((None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}])) to volume 450ba672-b9dd-4704-8b00-2b04d767e905 successfully. {{(pid=87229) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Temporary image 8cf76993-c51d-46eb-903b-c51338726200 for user 0700d9e590d344d3b76569f583325739 is deleted. {{(pid=87229) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.volume_utils [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Marking volume 450ba672-b9dd-4704-8b00-2b04d767e905 as bootable. {{(pid=87229) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Copying metadata from image 8cf76993-c51d-46eb-903b-c51338726200 to 450ba672-b9dd-4704-8b00-2b04d767e905. {{(pid=87229) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Creating volume glance metadata for volume 450ba672-b9dd-4704-8b00-2b04d767e905 backed by image 8cf76993-c51d-46eb-903b-c51338726200 with: {'image_id': '8cf76993-c51d-46eb-903b-c51338726200', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '88a636d472bf1cdbf46baf1bf075a2af', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87229) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196040d8-f65f-4ada-bd72-8ffc662d1404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450ba672-b9dd-4704-8b00-2b04d767e905', 'volume_size': 1, 'image_id': '8cf76993-c51d-46eb-903b-c51338726200', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8cf76993-c51d-46eb-903b-c51338726200', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88a636d472bf1cdbf46baf1bf075a2af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9803285a789848508b2cc1ac9e88f2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9e17c52be343b399588dc2da6f996e37cd0ead3f67c4d6c469bb6230f99629ee30e6d57537f8734abd49d3143e45774f099d15b0a3ee790e342c4f3e4156639', 'id': '8cf76993-c51d-46eb-903b-c51338726200', 'created_at': datetime.datetime(2026, 7, 8, 17, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8cf76993-c51d-46eb-903b-c51338726200/file', 'properties': {}}, 'image_service': }' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9892d2b9-cd6a-433a-8966-20be3e5d3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Volume volume-450ba672-b9dd-4704-8b00-2b04d767e905 (450ba672-b9dd-4704-8b00-2b04d767e905): created successfully Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9892d2b9-cd6a-433a-8966-20be3e5d3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Flow 'volume_create_manager' (7ee1afa9-6cc4-4e43-b38f-cbdeaab4677c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a59fd56f-5c6a-49d0-a48c-d58deb3893d2 tempest-VolumeImageDependencyTests-559067955 None] Created volume successfully. Jul 08 19:07:05 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43" returned: 0 in 1.146s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:06 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43 Jul 08 19:07:06 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:06 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 1.042s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:07:06 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Converted 1024.00 MB image at 175.47 MB/s Jul 08 19:07:06 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a is being set with open permissions: ugo+rw Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:06 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a Jul 08 19:07:06 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:06 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9.b18f82d7-8a9c-4503-a11d-bb5085a49b43" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-b18f82d7-8a9c-4503-a11d-bb5085a49b43" released by "_delete_snapshot" :: held 5.788s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" released by "delete_snapshot" :: held 5.834s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['d7cf5826-ae7f-44d5-9503-313563e8c127', 'c4645840-8393-4a09-9366-0a6eef2b8a01', 'c41ee01e-ce37-4b62-9676-c909f9cac0a8', 'b7b3674e-95ec-4ef6-bfda-e96b83de8071'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Delete snapshot completed successfully. Jul 08 19:07:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bdc548c7-c75a-4af0-ae42-9dd7fd5c4887 tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-b18f82d7-8a9c-4503-a11d-bb5085a49b43-delete_snapshot" released by "delete_snapshot" :: held 6.027s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Acquiring lock "cinder-450ba672-b9dd-4704-8b00-2b04d767e905-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "cinder-450ba672-b9dd-4704-8b00-2b04d767e905-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Acquiring lock "cinder-quobyte-450ba672-b9dd-4704-8b00-2b04d767e905" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "cinder-quobyte-450ba672-b9dd-4704-8b00-2b04d767e905" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576a37b-b343-4877-947c-93905716be7f]: (4, 'raw') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:07 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:07:07 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:07 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" released by "_copy_volume_from_snapshot" :: held 9.603s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f-a9553a58-9128-4360-8b23-f2608eda559a" released by "_create_volume_from_snapshot" :: held 9.668s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.711s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.467s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Creating offline snapshot c858ff12-df28-44ea-b4ca-1c03ab645fc6 of volume 8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe5de83-e9f4-4c2c-87a4-e3da8c70413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9553a58-9128-4360-8b23-f2608eda559a', 'volume_size': 1, 'snapshot_id': '0bcc8338-aa1c-4c63-91c4-be6b560c667f'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8691b066-c417-4b08-ac1a-135b033d5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f29afe0-ef17-4925-ad2f-4b13afed69fd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Volume volume-a9553a58-9128-4360-8b23-f2608eda559a (a9553a58-9128-4360-8b23-f2608eda559a): created successfully Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8691b066-c417-4b08-ac1a-135b033d5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Flow 'volume_create_manager' (69baf756-dd85-4514-ac91-fc013204bd57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-a3cc6c28-5791-4779-8455-c1eecf48a6f9-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7f58116f-d8be-4c27-92b4-eaea19b34e10 tempest-VolumeDependencyTests-8951478 None] Created volume successfully. Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-a3cc6c28-5791-4779-8455-c1eecf48a6f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:07 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 Jul 08 19:07:07 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b513d24-ac95-46f5-85da-07938c1dd5aa]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:07 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 Jul 08 19:07:07 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:08 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 0 in 0.909s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-0bcc8338-aa1c-4c63-91c4-be6b560c667f-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-0bcc8338-aa1c-4c63-91c4-be6b560c667f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:08 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:07:08 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Deleting offline snapshot 0bcc8338-aa1c-4c63-91c4-be6b560c667f of volume 773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] snapshot_file for this snap is: volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa35f3-8f3b-45fa-800c-f1b21abe5a46]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:08 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6" returned: 0 in 0.916s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:08 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 1G Jul 08 19:07:08 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:08 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:07:08 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:08 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9" returned: 0 in 0.884s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:08 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9 Jul 08 19:07:08 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:09 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 1 in 0.955s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905' failed. Not Retrying. {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:09 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905 Jul 08 19:07:09 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:09 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a3cc6c28-5791-4779-8455-c1eecf48a6f9" returned: 0 in 0.716s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:09 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 0.922s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-773132b9-5f6c-44d3-af7b-33a037dbea3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-quobyte-a3cc6c28-5791-4779-8455-c1eecf48a6f9" released by "delete_volume" :: held 1.707s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14cc7ce-c219-428e-a656-35d0e960bbca]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:09 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 1G" returned: 0 in 0.990s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:09 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 Jul 08 19:07:09 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Created reservations ['3a57c103-76fd-4777-9187-0351e46ccd66', '8948c5da-9a47-4e69-b4c4-9ef3beda3f92', 'ecb90c03-53d4-4e40-9546-b7a9e280d1b3', 'c6d34810-be21-439e-ac5a-c67a720abbc8'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:09 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:07:09 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:09 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:09 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:09 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-450ba672-b9dd-4704-8b00-2b04d767e905" returned: 0 in 0.711s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "cinder-quobyte-450ba672-b9dd-4704-8b00-2b04d767e905" released by "delete_volume" :: held 2.642s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Created reservations ['4b35c2e1-bd84-468d-ba5d-7d00e645d1e7', '863bd123-5967-4988-89e0-32de355349e5', 'bf1d5300-332e-4245-8fff-e16bb2abefe2', '9cec9d76-984e-44a9-b94e-20a987776169'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:10 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:10 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:10 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 1.023s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:10 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:07:10 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:10 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:10 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.961s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:10 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Deleted volume successfully. Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6" returned: 0 in 1.141s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:10 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 is being set with open permissions: ugo+rw Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8d8eff6b-1e34-48cc-af3d-45f4687ec1bd tempest-CreateVolumesFromSnapshotTest-329003579 None] Lock "cinder-a3cc6c28-5791-4779-8455-c1eecf48a6f9-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:10 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 Jul 08 19:07:10 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:11 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 1.111s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Deleted volume successfully. Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f688284d-a034-44ff-ba5d-f49acccc046e tempest-VolumeImageDependencyTests-559067955 None] Lock "cinder-450ba672-b9dd-4704-8b00-2b04d767e905-delete_volume" released by "delete_volume" :: held 4.064s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:11 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 1.180s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:11 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6" returned: 0 in 1.044s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:11 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f Jul 08 19:07:11 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:11 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info Jul 08 19:07:11 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:12 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d.0bcc8338-aa1c-4c63-91c4-be6b560c667f" returned: 0 in 0.729s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-0bcc8338-aa1c-4c63-91c4-be6b560c667f" released by "_delete_snapshot" :: held 4.009s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" released by "delete_snapshot" :: held 4.042s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Created reservations ['e1680efd-f293-4de4-97a8-80ddf43a8c82', '7669067d-b3ef-4bf5-bb86-82208a8df6bd', '7360ca62-d710-4a25-9645-782decb0bf24', 'b0194ea0-abf4-476d-b49a-4accd924247c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Delete snapshot completed successfully. Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e8e98a1f-f222-40e9-8dfa-52a4f5e05607 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-0bcc8338-aa1c-4c63-91c4-be6b560c667f-delete_snapshot" released by "delete_snapshot" :: held 4.253s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:12 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info" returned: 0 in 0.982s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:12 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info is being set with open permissions: ugo+rw Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-773132b9-5f6c-44d3-af7b-33a037dbea3d-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:12 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info Jul 08 19:07:12 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-773132b9-5f6c-44d3-af7b-33a037dbea3d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2997e-7b64-4afa-bc95-af7f26106ff4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:12 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:07:12 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:13 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.info" returned: 0 in 0.714s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.945s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4a1f75a8-b8d1-42b9-a109-8fdd1fb87500 tempest-ProjectReaderTests-290467064 None] Create snapshot completed successfully Jul 08 19:07:13 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 0.890s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:13 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d Jul 08 19:07:13 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-c858ff12-df28-44ea-b4ca-1c03ab645fc6-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-c858ff12-df28-44ea-b4ca-1c03ab645fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-c858ff12-df28-44ea-b4ca-1c03ab645fc6" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c858ff12-df28-44ea-b4ca-1c03ab645fc6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Deleting offline snapshot c858ff12-df28-44ea-b4ca-1c03ab645fc6 of volume 8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] snapshot_file for this snap is: volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed014736-1715-432b-86d9-1d22f77cca0b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:14 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 Jul 08 19:07:14 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:14 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-773132b9-5f6c-44d3-af7b-33a037dbea3d" returned: 0 in 0.739s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-773132b9-5f6c-44d3-af7b-33a037dbea3d" released by "delete_volume" :: held 1.721s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Created reservations ['fa2b5de6-52ff-4822-b0b6-34fca9951fa0', '84a07099-0825-4a5d-a870-d10903fc20fd', 'a79f0d3e-2961-4c50-b737-fcdae018c5cb', '3f1ce454-4059-456d-bcd3-e93b92748850'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:14 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:14 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-a9553a58-9128-4360-8b23-f2608eda559a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "cinder-a9553a58-9128-4360-8b23-f2608eda559a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:14 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6" returned: 0 in 1.027s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f2104e7-8e7b-4103-972a-888938b0d8e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Flow 'volume_create_manager' (18e5e1a9-b44c-47a8-b8b2-14ed52f7b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec237d9-f0d4-4c5f-ae5a-7c3ab8da6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[decba5a5-3a4f-4536-8193-d604eebee4ea]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec237d9-f0d4-4c5f-ae5a-7c3ab8da6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116ab7c8-915f-413b-b22f-ccb70fb964b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067f2c489a78465cb70cfe8ec6f65012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:15Z,use_quota=True,user_id='0c62052ec0044d68bc68499c76b95eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a5c15e-29a2-41e8-a64e-53616bb15799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a5c15e-29a2-41e8-a64e-53616bb15799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e25844f-250c-47b3-a2d8-abf4d802a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e25844f-250c-47b3-a2d8-abf4d802a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116ab7c8-915f-413b-b22f-ccb70fb964b8', 'volume_name': 'volume-116ab7c8-915f-413b-b22f-ccb70fb964b8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9dec41-0b74-4522-86d3-f92e4355e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9dec41-0b74-4522-86d3-f92e4355e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f36980-a31a-485d-90ac-9d4ba44cfeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:15 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Volume 116ab7c8-915f-413b-b22f-ccb70fb964b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116ab7c8-915f-413b-b22f-ccb70fb964b8', 'volume_size': 1} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116ab7c8-915f-413b-b22f-ccb70fb964b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067f2c489a78465cb70cfe8ec6f65012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:15Z,use_quota=True,user_id='0c62052ec0044d68bc68499c76b95eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Creating volume 116ab7c8-915f-413b-b22f-ccb70fb964b8 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:15 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Acquiring lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:15 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 1073741824 Jul 08 19:07:15 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:15 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:15 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c47d9-e363-4054-867b-c87ded57d85e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:15 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a Jul 08 19:07:15 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:15 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.832s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:15 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Deleted volume successfully. Jul 08 19:07:15 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1b3611db-6a1a-4850-8ed2-7d3e2e57ace9 tempest-VolumeDependencyTests-8951478 None] Lock "cinder-773132b9-5f6c-44d3-af7b-33a037dbea3d-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:16 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6" returned: 0 in 1.097s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:16 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 Jul 08 19:07:16 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:16 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 1073741824" returned: 0 in 1.087s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:16 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 Jul 08 19:07:16 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:16 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a" returned: 0 in 1.167s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:16 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a Jul 08 19:07:16 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:17 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8" returned: 0 in 0.795s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:17 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6" returned: 0 in 0.921s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f36980-a31a-485d-90ac-9d4ba44cfeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116ab7c8-915f-413b-b22f-ccb70fb964b8', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df31c33-f226-4889-80d3-3d41254e008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:17 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6 Jul 08 19:07:17 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:17 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Volume volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 (116ab7c8-915f-413b-b22f-ccb70fb964b8): created successfully Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df31c33-f226-4889-80d3-3d41254e008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Flow 'volume_create_manager' (18e5e1a9-b44c-47a8-b8b2-14ed52f7b091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-25e13e31-0090-4455-815d-9d560e03335a tempest-CinderUnicodeTest-1430832297 None] Created volume successfully. Jul 08 19:07:17 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-a9553a58-9128-4360-8b23-f2608eda559a" returned: 0 in 0.871s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "cinder-quobyte-a9553a58-9128-4360-8b23-f2608eda559a" released by "delete_volume" :: held 2.105s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Created reservations ['f00a57f2-f707-44e3-bccc-efc643c83126', 'ac4dc939-ed9e-474b-912d-3e65309fbc12', 'f8e03944-bf43-4b5c-bc73-ed77d37b6197', '50ce72a1-51f0-477f-b5f4-220fe9f45509'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:17 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:17 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:17 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6.c858ff12-df28-44ea-b4ca-1c03ab645fc6" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-c858ff12-df28-44ea-b4ca-1c03ab645fc6" released by "_delete_snapshot" :: held 3.884s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" released by "delete_snapshot" :: held 3.909s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:17 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Created reservations ['f4468953-d985-4d95-ba3f-739a5651ca9f', '7a0bc435-c279-4af3-b481-55cc17845214', '55e87592-ccad-4cea-96c1-889b0bd09c05', '29a0b092-06de-405a-839d-b216a5d81d23'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Delete snapshot completed successfully. Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1f7286da-d2b3-4e0d-b0db-466bf8986efd tempest-ProjectReaderTests-290467064 None] Lock "cinder-c858ff12-df28-44ea-b4ca-1c03ab645fc6-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:18 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.789s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Deleted volume successfully. Jul 08 19:07:18 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:18 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed8427f1-af25-42a5-a21a-9bb44259e9ed tempest-VolumeDependencyTests-8951478 None] Lock "cinder-a9553a58-9128-4360-8b23-f2608eda559a-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-8f2104e7-8e7b-4103-972a-888938b0d8e6-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "cinder-8f2104e7-8e7b-4103-972a-888938b0d8e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fed671-d7e5-472c-803c-f079680d03ff]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Flow 'volume_create_manager' (45ac1d4c-9bac-4f8d-b61d-0f291a756c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9235465e-9c12-4d71-93a8-b7e538e7c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9235465e-9c12-4d71-93a8-b7e538e7c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1031484769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692fbd3d-2ead-49cb-b3d8-664d845132f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067f2c489a78465cb70cfe8ec6f65012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:19Z,use_quota=True,user_id='0c62052ec0044d68bc68499c76b95eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afddbaf2-f7ef-4100-902e-8c601443ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afddbaf2-f7ef-4100-902e-8c601443ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee60e1a-abd2-4a02-89c3-2bb1c66ab138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee60e1a-abd2-4a02-89c3-2bb1c66ab138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692fbd3d-2ead-49cb-b3d8-664d845132f5', 'volume_name': 'volume-692fbd3d-2ead-49cb-b3d8-664d845132f5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de66052-2990-4aa6-a039-b36139d41e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de66052-2990-4aa6-a039-b36139d41e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:18 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 Jul 08 19:07:18 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425073b-b09a-493c-8f40-3c7f76430579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:18 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Volume 692fbd3d-2ead-49cb-b3d8-664d845132f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692fbd3d-2ead-49cb-b3d8-664d845132f5', 'volume_size': 1} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1031484769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692fbd3d-2ead-49cb-b3d8-664d845132f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067f2c489a78465cb70cfe8ec6f65012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:19Z,use_quota=True,user_id='0c62052ec0044d68bc68499c76b95eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Creating volume 692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:18 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:18 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 1073741824 Jul 08 19:07:18 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:19 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.856s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:07:19 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6" returned: 0 in 1.132s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:19 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6 Jul 08 19:07:19 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:19 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 1073741824" returned: 0 in 1.143s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:20 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 Jul 08 19:07:20 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:20 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-8f2104e7-8e7b-4103-972a-888938b0d8e6" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-8f2104e7-8e7b-4103-972a-888938b0d8e6" released by "delete_volume" :: held 2.019s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Created reservations ['aa9da6bc-29cd-457a-9c29-aec7d48c18b3', '61203204-93c4-4125-ac90-358e77dcae01', '75a314ec-e8d1-4c49-bd48-829b4425c818', '278ed947-67ee-4d10-9b94-2cd6e6a66f2e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:20 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5" returned: 0 in 0.782s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:20 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:20 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425073b-b09a-493c-8f40-3c7f76430579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692fbd3d-2ead-49cb-b3d8-664d845132f5', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2035dd5b-b535-455a-9b83-114f23296a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:20 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Volume volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 (692fbd3d-2ead-49cb-b3d8-664d845132f5): created successfully Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2035dd5b-b535-455a-9b83-114f23296a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Flow 'volume_create_manager' (45ac1d4c-9bac-4f8d-b61d-0f291a756c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2220a2c4-eb1f-4f8e-a0dd-a548bfc518eb tempest-CinderUnicodeTest-1430832297 None] Created volume successfully. Jul 08 19:07:21 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.767s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:21 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Deleted volume successfully. Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ba07ab8e-d651-4cf0-bb0c-3870591fbd63 tempest-ProjectReaderTests-290467064 None] Lock "cinder-8f2104e7-8e7b-4103-972a-888938b0d8e6-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (5da6855c-8fa3-4e73-b68d-6330a715a031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af669611-194a-4192-a939-e48b2a3ec3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af669611-194a-4192-a939-e48b2a3ec3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166437786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469ad040-3d1b-4f19-a79e-ee0ebe76689b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:22Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f921c71-c11d-4d63-b624-57d6c508b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f921c71-c11d-4d63-b624-57d6c508b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4ceb67-09fa-4b86-82b2-1d9a21f265bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4ceb67-09fa-4b86-82b2-1d9a21f265bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469ad040-3d1b-4f19-a79e-ee0ebe76689b', 'volume_name': 'volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1df91-e1db-40c2-9fda-959b22f90b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1df91-e1db-40c2-9fda-959b22f90b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e51bf5-d4dd-41a2-8a05-f54d92ef96fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:21 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Volume 469ad040-3d1b-4f19-a79e-ee0ebe76689b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b', 'volume_size': 1} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166437786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469ad040-3d1b-4f19-a79e-ee0ebe76689b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:22Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Creating volume 469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:21 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:21 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b 1073741824 Jul 08 19:07:21 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:22 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b 1073741824" returned: 0 in 1.012s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:22 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b Jul 08 19:07:22 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:23 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.281s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e51bf5-d4dd-41a2-8a05-f54d92ef96fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb4334c-dce3-4a72-9042-3d631d867260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Creating offline snapshot 5aceede3-0349-446c-9686-1840016454b9 of volume 692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2c8cd4c7-0f16-404a-8145-9e3818de8c6c tempest-ProjectAdminTests-1544901182 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7276611328125, 'free_capacity_gb': 1775.7276611328125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87229) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 19:07:23 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Volume volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b (469ad040-3d1b-4f19-a79e-ee0ebe76689b): created successfully Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb4334c-dce3-4a72-9042-3d631d867260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (5da6855c-8fa3-4e73-b68d-6330a715a031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0da19a-1f56-45c2-8af1-bcc27b0c312f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:23 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-cbc42a12-093c-44fd-87be-8f6c15bd9277 tempest-ProjectReaderTests-290467064 None] Created volume successfully. Jul 08 19:07:23 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 Jul 08 19:07:23 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:24 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5" returned: 0 in 0.876s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:24 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 1G Jul 08 19:07:24 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:25 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 1G" returned: 0 in 0.944s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:25 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 Jul 08 19:07:25 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:26 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:26 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 is being set with open permissions: ugo+rw Jul 08 19:07:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:26 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 Jul 08 19:07:26 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:26 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:26 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info Jul 08 19:07:26 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:27 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info" returned: 0 in 0.748s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:27 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info is being set with open permissions: ugo+rw Jul 08 19:07:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:27 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info Jul 08 19:07:27 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:28 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.info" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.910s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.527s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Creating offline snapshot ab3f6450-e5da-45d0-937d-422752744654 of volume 469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:07:28 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-30dc35ae-8b9e-4563-9a4a-1d09f32a6c55 tempest-CinderUnicodeTest-1430832297 None] Create snapshot completed successfully Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ef0a56-bb61-4b68-a54a-12528eeb7b9e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:28 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b Jul 08 19:07:28 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:29 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:29 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 1G Jul 08 19:07:29 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-5aceede3-0349-446c-9686-1840016454b9-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-5aceede3-0349-446c-9686-1840016454b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-quobyte-5aceede3-0349-446c-9686-1840016454b9" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-5aceede3-0349-446c-9686-1840016454b9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Deleting offline snapshot 5aceede3-0349-446c-9686-1840016454b9 of volume 692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] snapshot_file for this snap is: volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b827f60f-aa6d-49fe-92a6-1e656b2af7e3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:29 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 Jul 08 19:07:29 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:30 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 1G" returned: 0 in 0.982s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:30 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 Jul 08 19:07:30 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:30 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9" returned: 0 in 1.073s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-692fbd3d-2ead-49cb-b3d8-664d845132f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95a9e5-eb99-4ca8-8aba-125d1da728b3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:30 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 Jul 08 19:07:30 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:31 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 is being set with open permissions: ugo+rw Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:31 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 Jul 08 19:07:31 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:31 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5" returned: 0 in 0.950s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:31 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 Jul 08 19:07:31 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:31 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654" returned: 0 in 0.766s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:31 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info Jul 08 19:07:31 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:32 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9" returned: 0 in 0.843s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:32 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9 Jul 08 19:07:32 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:32 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info" returned: 0 in 0.848s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:32 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info is being set with open permissions: ugo+rw Jul 08 19:07:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:32 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info Jul 08 19:07:32 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:33 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5.5aceede3-0349-446c-9686-1840016454b9" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-5aceede3-0349-446c-9686-1840016454b9" released by "_delete_snapshot" :: held 3.780s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" released by "delete_snapshot" :: held 3.821s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Created reservations ['861c3016-2202-489b-9ec1-2ccdf8cd0cf6', '61a49da4-eed4-485e-b715-075dd5bfcad1', '53df3799-1c78-44b4-bcb3-157a680bab7c', 'ac5b2843-f573-4c05-ad1e-da8f5ca42f47'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Delete snapshot completed successfully. Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-8c4d13aa-511f-4ec1-bb84-492227b43329 tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-5aceede3-0349-446c-9686-1840016454b9-delete_snapshot" released by "delete_snapshot" :: held 4.069s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:33 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.info" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.353s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:33 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-72a22f1e-8fc8-4418-b6eb-5f5ac3299295 tempest-ProjectReaderTests-290467064 None] Create snapshot completed successfully Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-692fbd3d-2ead-49cb-b3d8-664d845132f5-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-692fbd3d-2ead-49cb-b3d8-664d845132f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da3297-f584-4a0f-b6d2-99275dc2c373]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (1b0c5082-6dc7-475f-addb-6289c8a87e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97eb31f-d08e-45d0-bd35-bccfc64ee908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97eb31f-d08e-45d0-bd35-bccfc64ee908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50490375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7892459-9048-4142-8081-570beb402e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:34Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51328619-e30d-4da7-a1e8-c481f6b99391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51328619-e30d-4da7-a1e8-c481f6b99391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c04831-f99f-4e93-87e0-c5704a2b40cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c04831-f99f-4e93-87e0-c5704a2b40cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7892459-9048-4142-8081-570beb402e18', 'volume_name': 'volume-c7892459-9048-4142-8081-570beb402e18', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af47627-716d-4465-9f78-039b98e1ec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:34 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af47627-716d-4465-9f78-039b98e1ec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:34 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743dd01e-f5ef-4681-a2b5-c934fde8e311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:34 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Volume c7892459-9048-4142-8081-570beb402e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7892459-9048-4142-8081-570beb402e18', 'volume_size': 1} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-50490375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7892459-9048-4142-8081-570beb402e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:34Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Creating volume c7892459-9048-4142-8081-570beb402e18 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:34 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-ab3f6450-e5da-45d0-937d-422752744654-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:34 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 1073741824 Jul 08 19:07:34 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-ab3f6450-e5da-45d0-937d-422752744654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-ab3f6450-e5da-45d0-937d-422752744654" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-ab3f6450-e5da-45d0-937d-422752744654" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Deleting offline snapshot ab3f6450-e5da-45d0-937d-422752744654 of volume 469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] snapshot_file for this snap is: volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fddb65-5d54-44c4-8f47-53e9771e072b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:34 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 Jul 08 19:07:34 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:35 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5" returned: 0 in 0.924s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:35 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5 Jul 08 19:07:35 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:35 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654" returned: 0 in 0.961s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:35 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 1073741824" returned: 0 in 1.123s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[271d45ac-cee1-4235-842c-4c30e64198d6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:35 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 Jul 08 19:07:35 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:35 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b Jul 08 19:07:35 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:35 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-692fbd3d-2ead-49cb-b3d8-664d845132f5" returned: 0 in 0.887s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-692fbd3d-2ead-49cb-b3d8-664d845132f5" released by "delete_volume" :: held 1.903s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Created reservations ['6bd6f577-f46f-490c-bf5a-39e53373846b', '4aa5eb24-b709-464d-bb9c-a7efbd09d447', 'ced2140e-de82-4e05-930b-13b416887938', 'a04e376a-7e69-475a-aeae-ba4e092eb44a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:36 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:36 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-116ab7c8-915f-413b-b22f-ccb70fb964b8-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:36 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-116ab7c8-915f-413b-b22f-ccb70fb964b8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b" returned: 0 in 0.959s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:36 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18" returned: 0 in 0.939s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:36 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 Jul 08 19:07:36 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743dd01e-f5ef-4681-a2b5-c934fde8e311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7892459-9048-4142-8081-570beb402e18', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bacb05-c7e1-4792-805e-9cee5ed8701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Volume volume-c7892459-9048-4142-8081-570beb402e18 (c7892459-9048-4142-8081-570beb402e18): created successfully Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bacb05-c7e1-4792-805e-9cee5ed8701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (1b0c5082-6dc7-475f-addb-6289c8a87e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "cinder-quobyte-116ab7c8-915f-413b-b22f-ccb70fb964b8" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a2cad433-8724-40fa-95c5-e2ee569c37da tempest-ProjectReaderTests-1025939084 None] Created volume successfully. Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-116ab7c8-915f-413b-b22f-ccb70fb964b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d7387-f9ad-4fe6-b311-11eefa365bd6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:36 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 Jul 08 19:07:36 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:37 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:37 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Deleted volume successfully. Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-15f3adf4-8616-46ea-bd90-37e4351ccc6e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-692fbd3d-2ead-49cb-b3d8-664d845132f5-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:37 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654" returned: 0 in 0.936s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:37 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654 Jul 08 19:07:37 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:37 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8" returned: 0 in 0.984s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:37 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8 Jul 08 19:07:37 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-c7892459-9048-4142-8081-570beb402e18-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "cinder-c7892459-9048-4142-8081-570beb402e18-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-quobyte-c7892459-9048-4142-8081-570beb402e18" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-c7892459-9048-4142-8081-570beb402e18" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf5f30-d33d-42ab-9610-1fb1ff7e8a49]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:38 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 Jul 08 19:07:38 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:38 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b.ab3f6450-e5da-45d0-937d-422752744654" returned: 0 in 0.793s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-ab3f6450-e5da-45d0-937d-422752744654" released by "_delete_snapshot" :: held 3.778s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" released by "delete_snapshot" :: held 3.813s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Created reservations ['6762afa2-3824-4331-bb48-e1e67669f255', '148841bb-979a-449b-9876-9d9680b93e04', '2adc693f-3875-4d4d-b31b-79f09c4c825e', '93ad287e-a24d-4aa2-99d0-cfbf002c7fd5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Delete snapshot completed successfully. Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b28a66fd-bd47-4eb2-96ee-3e51d4b73fc5 tempest-ProjectReaderTests-290467064 None] Lock "cinder-ab3f6450-e5da-45d0-937d-422752744654-delete_snapshot" released by "delete_snapshot" :: held 3.985s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:38 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-116ab7c8-915f-413b-b22f-ccb70fb964b8" returned: 0 in 0.882s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-quobyte-116ab7c8-915f-413b-b22f-ccb70fb964b8" released by "delete_volume" :: held 1.921s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Created reservations ['51417d40-567a-4bad-bcdc-664ea1d9724a', '4900a435-e68a-4866-81d9-ba5236a8ddcd', 'a760492e-c631-4d49-88d0-b54e2ead182c', 'b0efce77-9ff5-4d32-91e5-8a13714026a6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:38 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:38 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-469ad040-3d1b-4f19-a79e-ee0ebe76689b-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "cinder-469ad040-3d1b-4f19-a79e-ee0ebe76689b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:38 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18" returned: 0 in 1.020s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f14360-1f24-45a4-93f8-c31671ea8cd1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:38 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18 Jul 08 19:07:38 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:39 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b Jul 08 19:07:39 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:39 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.941s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:39 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:39 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Deleted volume successfully. Jul 08 19:07:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e5e2d369-2d5d-4e31-b11b-862e20da2a4e tempest-CinderUnicodeTest-1430832297 None] Lock "cinder-116ab7c8-915f-413b-b22f-ccb70fb964b8-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:39 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c7892459-9048-4142-8081-570beb402e18" returned: 0 in 1.021s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:39 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-c7892459-9048-4142-8081-570beb402e18" released by "delete_volume" :: held 2.109s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Created reservations ['f3f45683-4201-4784-b8c8-9fceeaae292e', '6455a6f5-eaaa-4ce4-bf36-4defc42f9aee', '2b31db00-7590-49bd-8aae-19ec0026787e', '5ea397fe-d14f-483c-a322-738c52400f1b'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:40 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b" returned: 0 in 1.186s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:40 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b Jul 08 19:07:40 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:40 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:40 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:40 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-469ad040-3d1b-4f19-a79e-ee0ebe76689b" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:40 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-469ad040-3d1b-4f19-a79e-ee0ebe76689b" released by "delete_volume" :: held 2.075s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:41 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.821s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:41 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Deleted volume successfully. Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Created reservations ['f9134925-3aa3-4b94-a305-5143d8e27ec7', '9fecacee-3e4f-49dc-91d2-80a479fb2095', '38ae1606-15b4-4955-b269-6b537aa58bc8', '53049cb4-b2b8-431f-8893-db724b099842'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9fbbcd9e-05e7-4381-88aa-e689924ec33b tempest-ProjectReaderTests-1025939084 None] Lock "cinder-c7892459-9048-4142-8081-570beb402e18-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:41 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:41 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (299c5065-2375-4313-a35f-8dfff203d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d361bed-8cf1-4abd-9e7c-6c8cfcf71b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d361bed-8cf1-4abd-9e7c-6c8cfcf71b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729870588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7257856-f6db-4b5b-8555-78c6cf29128e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:42Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d866257-f886-44ae-bfab-b7e043ef8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d866257-f886-44ae-bfab-b7e043ef8d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b914c96-e266-4256-bc84-ce19bed606bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b914c96-e266-4256-bc84-ce19bed606bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7257856-f6db-4b5b-8555-78c6cf29128e', 'volume_name': 'volume-b7257856-f6db-4b5b-8555-78c6cf29128e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ef286f-cbba-44f9-8409-d4067dc9afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ef286f-cbba-44f9-8409-d4067dc9afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce45cbf1-07af-4c98-bd4b-6aecb35e78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Volume b7257856-f6db-4b5b-8555-78c6cf29128e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7257856-f6db-4b5b-8555-78c6cf29128e', 'volume_size': 1} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729870588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7257856-f6db-4b5b-8555-78c6cf29128e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:42Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Creating volume b7257856-f6db-4b5b-8555-78c6cf29128e {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:41 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:41 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.866s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Deleted volume successfully. Jul 08 19:07:42 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e 1073741824 Jul 08 19:07:42 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9137e9aa-3ea8-483b-85b9-33f3d0e9daf0 tempest-ProjectReaderTests-290467064 None] Lock "cinder-469ad040-3d1b-4f19-a79e-ee0ebe76689b-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (1a0ec69d-e2c7-49cf-8626-e06a2770876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05c7db8-a0be-43ae-8218-2ec51d691ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05c7db8-a0be-43ae-8218-2ec51d691ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422661441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5592ad-f28c-4df0-9e73-3edc29f8e844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:43Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f597e2-dfd3-4ff7-9892-341773ac41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f597e2-dfd3-4ff7-9892-341773ac41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d92bcd-93f2-4f15-8b0c-c2ecebca980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d92bcd-93f2-4f15-8b0c-c2ecebca980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5592ad-f28c-4df0-9e73-3edc29f8e844', 'volume_name': 'volume-db5592ad-f28c-4df0-9e73-3edc29f8e844', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b64236-67ad-4647-825c-c53833e75e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b64236-67ad-4647-825c-c53833e75e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842e22bc-45d5-4471-811a-ab7c1d7b1e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:42 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Volume db5592ad-f28c-4df0-9e73-3edc29f8e844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5592ad-f28c-4df0-9e73-3edc29f8e844', 'volume_size': 1} Jul 08 19:07:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:43 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e 1073741824" returned: 0 in 1.056s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:43 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e Jul 08 19:07:43 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (66ef3b3a-83fe-40fb-9256-8312add1f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1616515-86b1-4a2b-b604-00a02aad715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422661441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5592ad-f28c-4df0-9e73-3edc29f8e844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e43467556f4a5f9b67be9be995c4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:43Z,use_quota=True,user_id='9fce0b81ff4a4f2db6364e3fe018fee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Creating volume db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:43 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1616515-86b1-4a2b-b604-00a02aad715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962721021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:44Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeafe6e-626b-44e8-b249-e41865cadc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 1073741824 Jul 08 19:07:43 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeafe6e-626b-44e8-b249-e41865cadc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2283169b-6fc8-4f1e-9ed0-835fbd1b7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2283169b-6fc8-4f1e-9ed0-835fbd1b7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3', 'volume_name': 'volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c917b0e4-ee92-46fe-8630-9f0ef0926237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c917b0e4-ee92-46fe-8630-9f0ef0926237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a511f0-55eb-4fd4-bac9-b276d6c77533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Volume 3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3', 'volume_size': 1} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce45cbf1-07af-4c98-bd4b-6aecb35e78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7257856-f6db-4b5b-8555-78c6cf29128e', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc2594-d80e-4bb9-9576-ff13f0e171c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Volume volume-b7257856-f6db-4b5b-8555-78c6cf29128e (b7257856-f6db-4b5b-8555-78c6cf29128e): created successfully Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc2594-d80e-4bb9-9576-ff13f0e171c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (299c5065-2375-4313-a35f-8dfff203d002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:44 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4940351b-22af-4cd6-9da8-4aa6c21721f6 tempest-ProjectReaderTests-1025939084 None] Created volume successfully. Jul 08 19:07:44 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 1073741824" returned: 0 in 0.890s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:44 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 Jul 08 19:07:44 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-b7257856-f6db-4b5b-8555-78c6cf29128e-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-b7257856-f6db-4b5b-8555-78c6cf29128e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-quobyte-b7257856-f6db-4b5b-8555-78c6cf29128e" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-b7257856-f6db-4b5b-8555-78c6cf29128e" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a96a0-6dca-455d-afde-9a01a8f4d01e]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:45 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e Jul 08 19:07:45 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:45 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844" returned: 0 in 0.657s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962721021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:44Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Creating volume 3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:45 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842e22bc-45d5-4471-811a-ab7c1d7b1e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5592ad-f28c-4df0-9e73-3edc29f8e844', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a01b0-97d8-4902-bcf5-cd95edd017b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:45 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 1073741824 Jul 08 19:07:45 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:45 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Volume volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 (db5592ad-f28c-4df0-9e73-3edc29f8e844): created successfully Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a01b0-97d8-4902-bcf5-cd95edd017b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:45 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Flow 'volume_create_manager' (1a0ec69d-e2c7-49cf-8626-e06a2770876a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5a26d067-4046-4dd9-905e-4a20c578916b tempest-ProjectReaderTests-290467064 None] Created volume successfully. Jul 08 19:07:46 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e" returned: 0 in 0.908s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:46 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e Jul 08 19:07:46 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:46 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 1073741824" returned: 0 in 1.005s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:46 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 Jul 08 19:07:46 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:46 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-b7257856-f6db-4b5b-8555-78c6cf29128e" returned: 0 in 0.767s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-b7257856-f6db-4b5b-8555-78c6cf29128e" released by "delete_volume" :: held 1.724s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:46 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Created reservations ['a2a057f1-aeb9-4d3c-8cff-f2852a61622b', 'cf6c13f5-8148-469a-a19c-94e97d16aa56', 'b6a2e4c0-de0f-44ce-8045-6be21ff1d0e4', '11a8e237-4d71-4d27-9a00-85941abe9b23'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:47 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:47 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:47 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" returned: 0 in 0.728s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.054s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a511f0-55eb-4fd4-bac9-b276d6c77533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf02b57-8005-44bc-b405-ea74b2448f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Creating offline snapshot 3c9a5315-64ce-4298-9982-1a9843a6406d of volume db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:07:47 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Volume volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 (3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3): created successfully Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf02b57-8005-44bc-b405-ea74b2448f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (66ef3b3a-83fe-40fb-9256-8312add1f26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b30b9-18b1-4443-a44e-175a0fbd4ade]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a914c448-5fb6-47af-841a-cb2b4557fb7a tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:07:47 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 Jul 08 19:07:47 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:47 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.751s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:47 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Deleted volume successfully. Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0273e7a9-4a4e-492c-b245-79b2569311b5 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-b7257856-f6db-4b5b-8555-78c6cf29128e-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:47 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (b00769a7-49e3-49d6-a343-268d8b0fb856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef58f9e-f43a-4623-a642-c920e74b5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef58f9e-f43a-4623-a642-c920e74b5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9737347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd09445d-6421-4366-a0bc-d401de3f5a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:48Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ba01c-4d22-4a80-9e01-5aa823aef752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ba01c-4d22-4a80-9e01-5aa823aef752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e8ee9b-b6c8-4da5-90e3-24bd173a2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e8ee9b-b6c8-4da5-90e3-24bd173a2f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd09445d-6421-4366-a0bc-d401de3f5a81', 'volume_name': 'volume-dd09445d-6421-4366-a0bc-d401de3f5a81', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f114655-e2c2-4dbd-bbb0-bad5a5d47d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f114655-e2c2-4dbd-bbb0-bad5a5d47d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9330247a-3eb4-4e78-af64-c8762325c407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:48 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Volume dd09445d-6421-4366-a0bc-d401de3f5a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd09445d-6421-4366-a0bc-d401de3f5a81', 'volume_size': 1} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:48 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844" returned: 0 in 0.967s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:48 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d 1G Jul 08 19:07:48 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:49 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d 1G" returned: 0 in 0.859s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:49 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d Jul 08 19:07:49 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:49 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:49 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d is being set with open permissions: ugo+rw Jul 08 19:07:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:49 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d Jul 08 19:07:49 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:50 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:50 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info Jul 08 19:07:50 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:51 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info" returned: 0 in 0.690s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:51 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info is being set with open permissions: ugo+rw Jul 08 19:07:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:51 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info Jul 08 19:07:51 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:52 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.info" returned: 0 in 0.727s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9737347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd09445d-6421-4366-a0bc-d401de3f5a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:48Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Creating volume dd09445d-6421-4366-a0bc-d401de3f5a81 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:52 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:INSERT=53,cinder:UPDATE=183,cinder:SELECT=141,cinder:DELETE=13 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=129,cinder:UPDATE=180,cinder:INSERT=48,cinder:DELETE=17 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:07:52 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 1073741824 Jul 08 19:07:52 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-01657a5e-fff1-4300-9b00-77978b8fabdb tempest-ProjectReaderTests-290467064 None] Create snapshot completed successfully Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-3c9a5315-64ce-4298-9982-1a9843a6406d-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-3c9a5315-64ce-4298-9982-1a9843a6406d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-3c9a5315-64ce-4298-9982-1a9843a6406d" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-3c9a5315-64ce-4298-9982-1a9843a6406d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Deleting offline snapshot 3c9a5315-64ce-4298-9982-1a9843a6406d of volume db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] snapshot_file for this snap is: volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65343428-f454-49c5-9614-537d1a2a24f0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:52 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d Jul 08 19:07:52 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:52 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 1073741824" returned: 0 in 0.837s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:52 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 Jul 08 19:07:52 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:53 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db5592ad-f28c-4df0-9e73-3edc29f8e844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cf9e59-6748-41c8-a1b4-e45efa4e857c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:53 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 Jul 08 19:07:53 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:53 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.947s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9330247a-3eb4-4e78-af64-c8762325c407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd09445d-6421-4366-a0bc-d401de3f5a81', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408d6139-9946-4f6b-9ecd-69d1f5037d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot a6b4c3b4-dc85-4970-ae09-ab6372391000 of volume 3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:07:53 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Volume volume-dd09445d-6421-4366-a0bc-d401de3f5a81 (dd09445d-6421-4366-a0bc-d401de3f5a81): created successfully Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408d6139-9946-4f6b-9ecd-69d1f5037d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (b00769a7-49e3-49d6-a343-268d8b0fb856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb6748a-19a6-45ee-a6f7-72fecadebd28]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:53 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-38ce8c25-9f5a-4159-8e2f-6f022a19e890 tempest-ProjectReaderTests-1025939084 None] Created volume successfully. Jul 08 19:07:53 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 Jul 08 19:07:53 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:54 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844" returned: 0 in 0.810s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:54 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d Jul 08 19:07:54 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-dd09445d-6421-4366-a0bc-d401de3f5a81-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-dd09445d-6421-4366-a0bc-d401de3f5a81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-quobyte-dd09445d-6421-4366-a0bc-d401de3f5a81" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-dd09445d-6421-4366-a0bc-d401de3f5a81" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0082ec3-00e4-427a-be9b-9485ef222f51]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:54 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" returned: 0 in 0.858s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:54 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 1G Jul 08 19:07:54 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:54 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 Jul 08 19:07:54 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:55 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d" returned: 0 in 0.820s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:55 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d Jul 08 19:07:55 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:55 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81" returned: 0 in 0.807s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:55 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81 Jul 08 19:07:55 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:55 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 1G" returned: 0 in 0.845s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:55 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 Jul 08 19:07:55 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:55 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844.3c9a5315-64ce-4298-9982-1a9843a6406d" returned: 0 in 0.733s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-3c9a5315-64ce-4298-9982-1a9843a6406d" released by "_delete_snapshot" :: held 3.237s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" released by "delete_snapshot" :: held 3.262s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Created reservations ['5d54af53-de64-4e3c-91fc-06031950e736', '3dc41b72-d871-4a23-9db5-98fb77810be9', '9ac3cb86-cd4c-4e71-94d2-0a28da3308ac', '2eb4e74d-03f8-4fbf-80f0-44e4ce9f1922'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:55 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Delete snapshot completed successfully. Jul 08 19:07:55 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2d5dfc4e-2d49-453a-9576-422ea1f155eb tempest-ProjectReaderTests-290467064 None] Lock "cinder-3c9a5315-64ce-4298-9982-1a9843a6406d-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:56 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-dd09445d-6421-4366-a0bc-d401de3f5a81" returned: 0 in 0.750s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-dd09445d-6421-4366-a0bc-d401de3f5a81" released by "delete_volume" :: held 1.619s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Created reservations ['375f879a-0972-449e-8f7d-62a884284bf8', '311c132c-2e4f-4e46-bc7a-8bb154b9edc2', '447bddcb-5822-41e8-b497-82368d609f75', 'eedc1446-f5ac-414b-aa44-dc52e675d3fa'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:56 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000" returned: 0 in 0.760s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:56 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 is being set with open permissions: ugo+rw Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:56 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 Jul 08 19:07:56 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:56 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:56 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-db5592ad-f28c-4df0-9e73-3edc29f8e844-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "cinder-db5592ad-f28c-4df0-9e73-3edc29f8e844-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Acquiring lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:56 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000" returned: 0 in 0.750s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" acquired by "delete_volume" :: waited 0.037s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ef1c1-b690-4e4d-8b69-e6c819524ae0]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:57 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.842s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:57 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Deleted volume successfully. Jul 08 19:07:57 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info Jul 08 19:07:57 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-ed4a41d6-9c70-44da-9b71-b7ede9016e22 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-dd09445d-6421-4366-a0bc-d401de3f5a81-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:57 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 Jul 08 19:07:57 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (f1ec556f-03d4-475f-9066-7ef9a8bd6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765b56ae-8573-422a-a625-b8fdac99066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765b56ae-8573-422a-a625-b8fdac99066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974927043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a9356e-cfb5-44b5-84b1-007fa6ac4b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:57Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f85149-57bb-41f9-81de-ab5009591b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f85149-57bb-41f9-81de-ab5009591b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3d8820-9085-4caa-9c14-1973aeb52800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3d8820-9085-4caa-9c14-1973aeb52800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a9356e-cfb5-44b5-84b1-007fa6ac4b76', 'volume_name': 'volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a89976-50c6-46cf-9dfa-4429fe99bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a89976-50c6-46cf-9dfa-4429fe99bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bebc65-e396-4f81-b533-c87087a15314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:07:57 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Volume 96a9356e-cfb5-44b5-84b1-007fa6ac4b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76', 'volume_size': 1} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:57 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info" returned: 0 in 0.667s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:57 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info is being set with open permissions: ugo+rw Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:57 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info Jul 08 19:07:57 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:57 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844" returned: 0 in 0.846s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:57 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844 Jul 08 19:07:57 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:58 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.info" returned: 0 in 0.713s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974927043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a9356e-cfb5-44b5-84b1-007fa6ac4b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582a03b37543424fa65ab659c1e84542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:07:57Z,use_quota=True,user_id='e2847c411309404e8eb2cb865c51df79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Creating volume 96a9356e-cfb5-44b5-84b1-007fa6ac4b76 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:07:58 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:58 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 1073741824 Jul 08 19:07:58 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:58 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b2a2ea9d-ef8e-488c-9b6f-4c9809f61788 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:07:58 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-db5592ad-f28c-4df0-9e73-3edc29f8e844" returned: 0 in 0.714s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "cinder-quobyte-db5592ad-f28c-4df0-9e73-3edc29f8e844" released by "delete_volume" :: held 1.650s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Created reservations ['62018f94-b1f6-4774-aec7-5d712dd90fa4', '0735027a-cf13-4fe9-a91f-8f95cd1d9587', '5debb8c0-057e-4e6b-9323-6583c636d1db', 'feacc3ef-c4e4-449f-9c28-dc44a5d83d79'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:07:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:58 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:07:58 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-a6b4c3b4-dc85-4970-ae09-ab6372391000-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-a6b4c3b4-dc85-4970-ae09-ab6372391000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-a6b4c3b4-dc85-4970-ae09-ab6372391000" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-a6b4c3b4-dc85-4970-ae09-ab6372391000" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot a6b4c3b4-dc85-4970-ae09-ab6372391000 of volume 3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91a483-94a3-48b8-950e-3d92d7f9aa7b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:59 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 Jul 08 19:07:59 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:07:59 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:07:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Deleted volume successfully. Jul 08 19:07:59 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 1073741824" returned: 0 in 1.059s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b2054922-b57a-4a82-9c70-679c3e32d23b tempest-ProjectReaderTests-290467064 None] Lock "cinder-db5592ad-f28c-4df0-9e73-3edc29f8e844-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:07:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:07:59 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 Jul 08 19:07:59 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:00 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000" returned: 0 in 0.913s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd2b60-39e5-45f8-8cbb-e23f0ab1859a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:00 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 Jul 08 19:08:00 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:00 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" returned: 0 in 0.827s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bebc65-e396-4f81-b533-c87087a15314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddf873f-da5a-486d-8ca4-e2f44fdad786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:00 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Volume volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 (96a9356e-cfb5-44b5-84b1-007fa6ac4b76): created successfully Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddf873f-da5a-486d-8ca4-e2f44fdad786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:00 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Flow 'volume_create_manager' (f1ec556f-03d4-475f-9066-7ef9a8bd6552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:00 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-52d9ad06-47f0-4023-95a2-891035edc208 tempest-ProjectReaderTests-1025939084 None] Created volume successfully. Jul 08 19:08:01 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" returned: 0 in 0.830s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:01 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 Jul 08 19:08:01 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-96a9356e-cfb5-44b5-84b1-007fa6ac4b76-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-96a9356e-cfb5-44b5-84b1-007fa6ac4b76-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "cinder-quobyte-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a739d6f9-8776-4d5f-9f80-a8d38321c343]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:01 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 Jul 08 19:08:01 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:01 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000" returned: 0 in 0.849s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:01 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000 Jul 08 19:08:01 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:02 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" returned: 0 in 0.788s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:02 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76 Jul 08 19:08:02 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:02 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3.a6b4c3b4-dc85-4970-ae09-ab6372391000" returned: 0 in 0.685s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-a6b4c3b4-dc85-4970-ae09-ab6372391000" released by "_delete_snapshot" :: held 3.427s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" released by "delete_snapshot" :: held 3.466s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Created reservations ['35f6ebe9-cfcf-401b-95cf-934d52921cee', 'a57ed585-5ea1-4672-80e6-b932224a828d', '0a39cab5-8b39-4cc0-a268-69fb0cf4b61e', '508e39da-dfd7-4849-8d60-ad121cbba9b1'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:02 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:08:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-86e25fda-7d3b-4508-855b-515ddbed7501 tempest-ProjectMemberTests-815295781 None] Lock "cinder-a6b4c3b4-dc85-4970-ae09-ab6372391000-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:03 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-quobyte-96a9356e-cfb5-44b5-84b1-007fa6ac4b76" released by "delete_volume" :: held 1.539s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Created reservations ['0abbc94a-74e0-4bd7-a079-1faa22257480', '3e2dcd73-2baf-4e37-bfce-6dfa9a5d8b24', '95c25e3e-ad36-4bcd-bcd2-418467ceeebc', '7c477143-8f16-4003-8566-25aae792325a'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:03 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:03 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Flow 'volume_create_manager' (3a970187-1068-4218-98e0-8f950776b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f627763-1e0b-4d49-add6-b65b7c2cb8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f627763-1e0b-4d49-add6-b65b7c2cb8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666237774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeefe43-bd79-49cd-99c0-ed47cda539aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f38a06bca3749119ccd2207c71ccdc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:03Z,use_quota=True,user_id='7806af7e53554dfe9f732e469ff4939a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba01496-3156-4f59-b81a-0f67f34b5198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba01496-3156-4f59-b81a-0f67f34b5198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef45624d-89b1-4678-ac21-27563a1fe3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef45624d-89b1-4678-ac21-27563a1fe3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eeefe43-bd79-49cd-99c0-ed47cda539aa', 'volume_name': 'volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6230b2-ea4b-48c8-ae81-cd42af6ec215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6230b2-ea4b-48c8-ae81-cd42af6ec215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eb8bec-b99e-40c7-802b-fcf1833307bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:03 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Volume 6eeefe43-bd79-49cd-99c0-ed47cda539aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa', 'volume_size': 1} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666237774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeefe43-bd79-49cd-99c0-ed47cda539aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f38a06bca3749119ccd2207c71ccdc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:03Z,use_quota=True,user_id='7806af7e53554dfe9f732e469ff4939a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Creating volume 6eeefe43-bd79-49cd-99c0-ed47cda539aa {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:03 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:03 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa 1073741824 Jul 08 19:08:03 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "cinder-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0d39ee-05f4-453a-8db1-9acc49bc8f92]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:03 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 Jul 08 19:08:03 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:03 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.746s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Deleted volume successfully. Jul 08 19:08:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2a47e0f0-c7cb-40f4-b10c-e97f95c81832 tempest-ProjectReaderTests-1025939084 None] Lock "cinder-96a9356e-cfb5-44b5-84b1-007fa6ac4b76-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:04 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa 1073741824" returned: 0 in 1.022s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:04 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" returned: 0 in 0.878s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:04 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3 Jul 08 19:08:04 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:04 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa Jul 08 19:08:04 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:05 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" returned: 0 in 0.744s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:05 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa" returned: 0 in 0.728s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3" released by "delete_volume" :: held 1.703s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61eb8bec-b99e-40c7-802b-fcf1833307bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020734a5-038d-4b3f-afa5-67ebafe17162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:05 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Volume volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa (6eeefe43-bd79-49cd-99c0-ed47cda539aa): created successfully Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020734a5-038d-4b3f-afa5-67ebafe17162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Flow 'volume_create_manager' (3a970187-1068-4218-98e0-8f950776b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:05 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3fb6a071-3cab-4503-9225-12877bd9c76c tempest-ProjectReaderTests-1619542783 None] Created volume successfully. Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Created reservations ['5a4cea78-d435-40a0-a4dc-4c65d540a12f', '774c3aac-2b89-428a-9c8f-27e8b9c63ebf', '1dc72582-25f6-4d8f-88a9-3c6517926f71', '40e866af-cbcc-4c13-bb7b-1853c08dc8c2'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:05 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:05 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Acquiring lock "cinder-6eeefe43-bd79-49cd-99c0-ed47cda539aa-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "cinder-6eeefe43-bd79-49cd-99c0-ed47cda539aa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Acquiring lock "cinder-quobyte-6eeefe43-bd79-49cd-99c0-ed47cda539aa" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "cinder-quobyte-6eeefe43-bd79-49cd-99c0-ed47cda539aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68843e3-a6fc-4c14-b581-d5f79dafda8c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:05 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa Jul 08 19:08:05 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:06 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f104d2da-eb98-4cda-9dba-459366279aa2 tempest-ProjectMemberTests-815295781 None] Lock "cinder-3c8b599a-f09e-44e4-8bbb-feb34e4d9fc3-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (34391a88-2cb1-4dab-85cc-d86766ea3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6f332-8650-480d-9b70-5bcb63c52e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb6f332-8650-480d-9b70-5bcb63c52e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599778636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76bf307-d759-4265-8ca2-1254a1fcee87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:06Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747e71c4-75ec-497e-a94b-59842bcc8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747e71c4-75ec-497e-a94b-59842bcc8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8446f3f4-b521-4423-b1ca-fb9048abd170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8446f3f4-b521-4423-b1ca-fb9048abd170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76bf307-d759-4265-8ca2-1254a1fcee87', 'volume_name': 'volume-c76bf307-d759-4265-8ca2-1254a1fcee87', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc69c84f-e611-4f00-984b-368624e9505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc69c84f-e611-4f00-984b-368624e9505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51af1c1f-b392-4583-a630-214152224a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:06 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Volume c76bf307-d759-4265-8ca2-1254a1fcee87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76bf307-d759-4265-8ca2-1254a1fcee87', 'volume_size': 1} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599778636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76bf307-d759-4265-8ca2-1254a1fcee87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:06Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Creating volume c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:06 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:06 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 1073741824 Jul 08 19:08:06 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:06 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa" returned: 0 in 0.832s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:06 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa Jul 08 19:08:06 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:07 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 1073741824" returned: 0 in 0.862s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:07 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 Jul 08 19:08:07 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:07 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-6eeefe43-bd79-49cd-99c0-ed47cda539aa" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "cinder-quobyte-6eeefe43-bd79-49cd-99c0-ed47cda539aa" released by "delete_volume" :: held 1.544s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Created reservations ['32c954ea-2e86-45a8-9918-b133cbf9f4e6', '7a647278-8fdf-4653-a0f8-843dc2b406d0', '14347181-39c2-4793-9ade-df1797dbe393', 'fba7a60b-8b69-4f87-a8eb-04841ce2d81b'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:07 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:07 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:07 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51af1c1f-b392-4583-a630-214152224a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76bf307-d759-4265-8ca2-1254a1fcee87', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21196b08-a306-42de-9e8c-78f9e7f96a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:07 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Volume volume-c76bf307-d759-4265-8ca2-1254a1fcee87 (c76bf307-d759-4265-8ca2-1254a1fcee87): created successfully Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21196b08-a306-42de-9e8c-78f9e7f96a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:07 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (34391a88-2cb1-4dab-85cc-d86766ea3909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8e078e1b-6eda-40a2-a3e9-d69626fdaa92 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:08:08 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.674s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Deleted volume successfully. Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49c0fdf5-ec46-4fed-b308-13e81fd52a6e tempest-ProjectReaderTests-1619542783 None] Lock "cinder-6eeefe43-bd79-49cd-99c0-ed47cda539aa-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot bd4ec9b7-3533-426b-bbac-b3184f519a8f of volume c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Flow 'volume_create_manager' (ef2b8dc6-1ac0-445f-8fdb-fd6181dbbf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026250f-2535-4cb7-b2d7-2f882105035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33801207-d6cf-4cc3-83e4-a192e27bdcdb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026250f-2535-4cb7-b2d7-2f882105035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093925433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245df6d6-0a46-463f-89aa-9da5fa192a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f38a06bca3749119ccd2207c71ccdc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:08Z,use_quota=True,user_id='7806af7e53554dfe9f732e469ff4939a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21434c61-c425-40cf-8ace-cb8d6cedab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21434c61-c425-40cf-8ace-cb8d6cedab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfffb0f-36c9-4855-8ddd-a2239e740acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfffb0f-36c9-4855-8ddd-a2239e740acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245df6d6-0a46-463f-89aa-9da5fa192a74', 'volume_name': 'volume-245df6d6-0a46-463f-89aa-9da5fa192a74', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd113c-e22e-42cb-b8a3-f99084172db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd113c-e22e-42cb-b8a3-f99084172db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f8c450-07b3-42e7-b825-3cac502ebc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:08 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Volume 245df6d6-0a46-463f-89aa-9da5fa192a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245df6d6-0a46-463f-89aa-9da5fa192a74', 'volume_size': 1} Jul 08 19:08:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:08 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 Jul 08 19:08:08 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:09 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87" returned: 0 in 0.734s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:09 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f 1G Jul 08 19:08:09 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:10 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f 1G" returned: 0 in 0.795s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76bf307-d759-4265-8ca2-1254a1fcee87 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:10 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76bf307-d759-4265-8ca2-1254a1fcee87 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f Jul 08 19:08:10 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:10 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76bf307-d759-4265-8ca2-1254a1fcee87 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f" returned: 0 in 0.681s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:10 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f is being set with open permissions: ugo+rw Jul 08 19:08:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:10 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f Jul 08 19:08:10 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:11 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f" returned: 0 in 0.629s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:11 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info Jul 08 19:08:11 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:12 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:12 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info is being set with open permissions: ugo+rw Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:12 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info Jul 08 19:08:12 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:12 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.info" returned: 0 in 0.641s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.234s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.121s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093925433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245df6d6-0a46-463f-89aa-9da5fa192a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f38a06bca3749119ccd2207c71ccdc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:08Z,use_quota=True,user_id='7806af7e53554dfe9f732e469ff4939a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Creating volume 245df6d6-0a46-463f-89aa-9da5fa192a74 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:12 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:12 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 1073741824 Jul 08 19:08:12 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:12 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-fee6baa2-e4ba-4811-892a-ee26a6e0e4e1 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:08:13 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 1073741824" returned: 0 in 0.819s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-bd4ec9b7-3533-426b-bbac-b3184f519a8f-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-bd4ec9b7-3533-426b-bbac-b3184f519a8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:13 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 Jul 08 19:08:13 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-bd4ec9b7-3533-426b-bbac-b3184f519a8f" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-bd4ec9b7-3533-426b-bbac-b3184f519a8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot bd4ec9b7-3533-426b-bbac-b3184f519a8f of volume c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea32428-978d-4339-901f-260e0d79eb0f]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:13 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f Jul 08 19:08:13 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:14 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74" returned: 0 in 0.658s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f8c450-07b3-42e7-b825-3cac502ebc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245df6d6-0a46-463f-89aa-9da5fa192a74', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318af7c6-e3e4-40e1-8baf-d842cc6f0189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:14 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Volume volume-245df6d6-0a46-463f-89aa-9da5fa192a74 (245df6d6-0a46-463f-89aa-9da5fa192a74): created successfully Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318af7c6-e3e4-40e1-8baf-d842cc6f0189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Flow 'volume_create_manager' (ef2b8dc6-1ac0-445f-8fdb-fd6181dbbf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:14 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-48bf3cea-f792-4b0a-9168-f61a5e0681a9 tempest-ProjectReaderTests-1619542783 None] Created volume successfully. Jul 08 19:08:14 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f" returned: 0 in 0.802s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76bf307-d759-4265-8ca2-1254a1fcee87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[09226557-8f13-4655-84bc-466174c8ad0a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:14 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 Jul 08 19:08:14 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Acquiring lock "cinder-245df6d6-0a46-463f-89aa-9da5fa192a74-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "cinder-245df6d6-0a46-463f-89aa-9da5fa192a74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Acquiring lock "cinder-quobyte-245df6d6-0a46-463f-89aa-9da5fa192a74" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "cinder-quobyte-245df6d6-0a46-463f-89aa-9da5fa192a74" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920c6f3-d7ae-4dd4-ad4a-eaffab2a53c1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:15 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 Jul 08 19:08:15 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:15 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87" returned: 0 in 0.850s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:15 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f Jul 08 19:08:15 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:15 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74" returned: 0 in 0.781s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:15 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74 Jul 08 19:08:15 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:16 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:16 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f Jul 08 19:08:16 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:16 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-245df6d6-0a46-463f-89aa-9da5fa192a74" returned: 0 in 0.721s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "cinder-quobyte-245df6d6-0a46-463f-89aa-9da5fa192a74" released by "delete_volume" :: held 1.546s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Created reservations ['096e9a5f-d7de-401b-a29e-e6036ce5dca6', '0b388539-2d4b-4eaa-9c91-6c4a2338e5f9', '013a0fe1-9793-421e-8002-80c69704c07f', '498ec388-43fc-490e-84b5-caf58886387c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:16 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:16 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:16 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87.bd4ec9b7-3533-426b-bbac-b3184f519a8f" returned: 0 in 0.684s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-bd4ec9b7-3533-426b-bbac-b3184f519a8f" released by "_delete_snapshot" :: held 3.213s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" released by "delete_snapshot" :: held 3.238s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:16 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Created reservations ['3e983b18-bf50-4cda-9edf-f009d1fd09bc', 'fa424a04-d5da-4150-99b0-f5a49ac62c10', 'c1e6cf15-54b5-4f1a-9f62-d7ab496a4ac0', 'b922c073-68e5-48e6-8b60-07d2b937b0d5'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-2f14688a-407e-4b39-89b9-09e46df7454f tempest-ProjectMemberTests-815295781 None] Lock "cinder-bd4ec9b7-3533-426b-bbac-b3184f519a8f-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:17 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.685s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:17 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Deleted volume successfully. Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-c88b44bf-6319-4f33-bc46-b3f929a17163 tempest-ProjectReaderTests-1619542783 None] Lock "cinder-245df6d6-0a46-463f-89aa-9da5fa192a74-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-c76bf307-d759-4265-8ca2-1254a1fcee87-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "cinder-c76bf307-d759-4265-8ca2-1254a1fcee87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:17 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d082674b-e774-428e-9767-fa2cd77fb776]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:18 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 Jul 08 19:08:18 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:18 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:18 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:18 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87" returned: 0 in 0.857s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:18 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87 Jul 08 19:08:18 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:18 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:08:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:08:19 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c76bf307-d759-4265-8ca2-1254a1fcee87" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-c76bf307-d759-4265-8ca2-1254a1fcee87" released by "delete_volume" :: held 1.608s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Created reservations ['4eefaa7f-4400-4f42-a431-e1320e0b92e2', '0d70722b-de8c-41b4-854a-6ea94d664b20', 'e2b76f86-c43b-424a-b6a6-36d8a6f0bcd2', '2c80f3af-9b03-450b-9f10-d380f5ee1bac'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:19 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:19 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:20 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.689s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:20 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-625ac2b7-a69b-4a16-a511-ed630072c57f tempest-ProjectMemberTests-815295781 None] Lock "cinder-c76bf307-d759-4265-8ca2-1254a1fcee87-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (96132043-dc40-42fc-8f2f-3a3db457e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4074bb2e-d4ea-42c0-8a3b-9d7f3f482c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4074bb2e-d4ea-42c0-8a3b-9d7f3f482c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267225800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add79de7-97f6-476a-914d-5132a3cdf5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:21Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b06c2c6-ece4-47d3-844b-d753e3825451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b06c2c6-ece4-47d3-844b-d753e3825451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337fe57c-52c2-4952-b978-386683136abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337fe57c-52c2-4952-b978-386683136abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add79de7-97f6-476a-914d-5132a3cdf5ae', 'volume_name': 'volume-add79de7-97f6-476a-914d-5132a3cdf5ae', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fc909-61f7-4daf-954f-c0ebb2b285c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fc909-61f7-4daf-954f-c0ebb2b285c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181e682e-42dd-4885-890c-f0865ff638e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:20 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Volume add79de7-97f6-476a-914d-5132a3cdf5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add79de7-97f6-476a-914d-5132a3cdf5ae', 'volume_size': 1} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267225800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add79de7-97f6-476a-914d-5132a3cdf5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:21Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Creating volume add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:20 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:20 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae 1073741824 Jul 08 19:08:20 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:21 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae 1073741824" returned: 0 in 0.855s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:21 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae Jul 08 19:08:21 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:22 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae" returned: 0 in 0.678s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181e682e-42dd-4885-890c-f0865ff638e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add79de7-97f6-476a-914d-5132a3cdf5ae', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a0635-b457-4055-93c0-42f0d5917784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:22 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Volume volume-add79de7-97f6-476a-914d-5132a3cdf5ae (add79de7-97f6-476a-914d-5132a3cdf5ae): created successfully Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a0635-b457-4055-93c0-42f0d5917784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (96132043-dc40-42fc-8f2f-3a3db457e351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5c99ef56-fe4b-4c1d-a28e-8944b399e675 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot 7d7ba925-6241-4a81-8a91-f074a24e3bed of volume add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2906b885-dc64-42c8-9368-0cb7557a7e2c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:23 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae Jul 08 19:08:23 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:23 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae" returned: 0 in 0.819s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:23 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed 1G Jul 08 19:08:23 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:24 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed 1G" returned: 0 in 0.869s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add79de7-97f6-476a-914d-5132a3cdf5ae -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:24 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add79de7-97f6-476a-914d-5132a3cdf5ae -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed Jul 08 19:08:24 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:25 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add79de7-97f6-476a-914d-5132a3cdf5ae -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed" returned: 0 in 0.742s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:25 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed is being set with open permissions: ugo+rw Jul 08 19:08:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:25 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed Jul 08 19:08:25 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:26 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed" returned: 0 in 0.753s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:26 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info Jul 08 19:08:26 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:26 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info" returned: 0 in 0.701s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:26 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info is being set with open permissions: ugo+rw Jul 08 19:08:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:26 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info Jul 08 19:08:26 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:27 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.info" returned: 0 in 0.673s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.653s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-5d01bff8-e4db-48c4-9791-c22024d795b2 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-7d7ba925-6241-4a81-8a91-f074a24e3bed-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-7d7ba925-6241-4a81-8a91-f074a24e3bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-7d7ba925-6241-4a81-8a91-f074a24e3bed" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-7d7ba925-6241-4a81-8a91-f074a24e3bed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot 7d7ba925-6241-4a81-8a91-f074a24e3bed of volume add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e81e850-d3e8-4e4d-9121-e5a14374f958]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:28 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed Jul 08 19:08:28 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:29 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed" returned: 0 in 0.875s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:29 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add79de7-97f6-476a-914d-5132a3cdf5ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:08:29 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b3bbe1-9f1b-4e49-939f-52c2c191cf46]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:29 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae Jul 08 19:08:29 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:29 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae" returned: 0 in 0.826s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:30 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed Jul 08 19:08:30 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:30 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed" returned: 0 in 0.898s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:30 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed Jul 08 19:08:30 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:31 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae.7d7ba925-6241-4a81-8a91-f074a24e3bed" returned: 0 in 0.703s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-7d7ba925-6241-4a81-8a91-f074a24e3bed" released by "_delete_snapshot" :: held 3.416s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" released by "delete_snapshot" :: held 3.442s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:31 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Created reservations ['fc31aa92-7aa3-4243-8eaa-b7b4b4a482cd', 'b358843b-c087-47ff-9f1a-e8f90089ea07', 'a325b9f8-e9a5-4082-8c79-a29af498fe8b', '66e9c9be-3de5-44a5-9fef-0baf4165854d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:31 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:08:31 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0bab8ddc-ad9a-485e-ac6f-740931312a0e tempest-ProjectMemberTests-815295781 None] Lock "cinder-7d7ba925-6241-4a81-8a91-f074a24e3bed-delete_snapshot" released by "delete_snapshot" :: held 3.608s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-add79de7-97f6-476a-914d-5132a3cdf5ae-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "cinder-add79de7-97f6-476a-914d-5132a3cdf5ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2dd607-e118-4869-8ad9-f97ef313ace6]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:32 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae Jul 08 19:08:32 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:33 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:33 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae Jul 08 19:08:33 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:34 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-add79de7-97f6-476a-914d-5132a3cdf5ae" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-add79de7-97f6-476a-914d-5132a3cdf5ae" released by "delete_volume" :: held 1.530s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Created reservations ['a7512b10-8743-451d-b748-d7c341d1ac1c', 'fa2da260-1dfc-4eef-ae62-9e9c6e2a3174', '07fd9b7e-d021-47f4-ba76-9255ea1190e1', '2daaca7c-76c2-4f4c-bd13-cac516aedbc6'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:34 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:34 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:34 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.645s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:34 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:08:34 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-874f0f8b-7d4b-4207-9f99-f2a2e9baea7d tempest-ProjectMemberTests-815295781 None] Lock "cinder-add79de7-97f6-476a-914d-5132a3cdf5ae-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (6d986dd8-7ee1-429f-9e2e-4f64d5a1417d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f13ee-061d-497f-adcf-abb1f2b6622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289f13ee-061d-497f-adcf-abb1f2b6622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955887876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbd4e04-8f63-462b-9ee6-25be61b2e07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:35Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b11fc-0939-411a-8af3-920204f0d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824b11fc-0939-411a-8af3-920204f0d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633ee09d-f5ea-4976-8b38-735131e38f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633ee09d-f5ea-4976-8b38-735131e38f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbd4e04-8f63-462b-9ee6-25be61b2e07f', 'volume_name': 'volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1392d167-d3d6-442f-9713-eb0c12533ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1392d167-d3d6-442f-9713-eb0c12533ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae48fb-7a27-414d-958c-1c5500fe349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:35 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Volume 9cbd4e04-8f63-462b-9ee6-25be61b2e07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f', 'volume_size': 1} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955887876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbd4e04-8f63-462b-9ee6-25be61b2e07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:35Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Creating volume 9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:35 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:35 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f 1073741824 Jul 08 19:08:35 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:36 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f 1073741824" returned: 0 in 0.857s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:36 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f Jul 08 19:08:36 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:36 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae48fb-7a27-414d-958c-1c5500fe349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a3ba3f-57b0-4d7d-8d12-b36a855f5964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:36 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Volume volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f (9cbd4e04-8f63-462b-9ee6-25be61b2e07f): created successfully Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a3ba3f-57b0-4d7d-8d12-b36a855f5964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:36 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (6d986dd8-7ee1-429f-9e2e-4f64d5a1417d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4651f044-bd16-4f26-80bb-0f687005aaf3 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:08:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:37 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot 4f28be25-1c27-4208-a3d9-83c8f448ee8e of volume 9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:08:37 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e703449-1896-46af-a63f-4e6cf0442ce3]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:37 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f Jul 08 19:08:37 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:38 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" returned: 0 in 0.860s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:38 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e 1G Jul 08 19:08:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:39 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e 1G" returned: 0 in 0.973s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:39 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e Jul 08 19:08:39 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:40 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e" returned: 0 in 0.817s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:40 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e is being set with open permissions: ugo+rw Jul 08 19:08:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:40 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e Jul 08 19:08:40 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:40 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:41 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info Jul 08 19:08:41 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:41 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info" returned: 0 in 0.694s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:41 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info is being set with open permissions: ugo+rw Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:41 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info Jul 08 19:08:41 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Flow 'volume_create_manager' (7a53563e-ec4d-466e-9b05-8cd4aa7298e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca62ba44-c7d9-4051-a1f1-e5a0c66b9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca62ba44-c7d9-4051-a1f1-e5a0c66b9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-563430233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f988a5-39db-4533-a89b-c2b9883ddc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a87d726d6d42448dfa514386ded058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:42Z,use_quota=True,user_id='3457cc1ea4944bc5a45507bc04d5d0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa0de6f-22a6-42db-9b79-463895cfa6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa0de6f-22a6-42db-9b79-463895cfa6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a90d78a-34d3-46bd-a8a2-b71c1d02efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a90d78a-34d3-46bd-a8a2-b71c1d02efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f988a5-39db-4533-a89b-c2b9883ddc9a', 'volume_name': 'volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c458cc-df32-4432-b69a-788abe6395b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c458cc-df32-4432-b69a-788abe6395b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40c8767-75ff-4039-97a6-31ca5b472434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:41 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Volume c1f988a5-39db-4533-a89b-c2b9883ddc9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a', 'volume_size': 1} Jul 08 19:08:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:42 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.info" returned: 0 in 0.629s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.859s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-563430233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f988a5-39db-4533-a89b-c2b9883ddc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a87d726d6d42448dfa514386ded058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:42Z,use_quota=True,user_id='3457cc1ea4944bc5a45507bc04d5d0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Creating volume c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:42 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:42 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a 1073741824 Jul 08 19:08:42 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:42 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-209604e4-ca29-479d-b0ce-2db0ad992631 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-4f28be25-1c27-4208-a3d9-83c8f448ee8e-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-4f28be25-1c27-4208-a3d9-83c8f448ee8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-4f28be25-1c27-4208-a3d9-83c8f448ee8e" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f28be25-1c27-4208-a3d9-83c8f448ee8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot 4f28be25-1c27-4208-a3d9-83c8f448ee8e of volume 9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88123b-628e-40cb-9fea-045ca87d8fdd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:42 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e Jul 08 19:08:42 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:43 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a 1073741824" returned: 0 in 0.820s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:43 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:08:43 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:43 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a910c6-1949-4a36-93b8-5ed057a7ed26]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:43 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f Jul 08 19:08:43 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:43 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.670s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40c8767-75ff-4039-97a6-31ca5b472434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3679bcc4-fb33-430b-bcf2-624d73f2ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:43 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Volume volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a (c1f988a5-39db-4533-a89b-c2b9883ddc9a): created successfully Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3679bcc4-fb33-430b-bcf2-624d73f2ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:43 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Flow 'volume_create_manager' (7a53563e-ec4d-466e-9b05-8cd4aa7298e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:43 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-492b006e-bed2-486a-96e4-68b25e31378d tempest-SnapshotDependencyTests-1112576721 None] Created volume successfully. Jul 08 19:08:44 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:44 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e Jul 08 19:08:44 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Creating offline snapshot 1dab5ae8-c044-4b60-b959-ca7ca9242c9b of volume c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd83d4-9acb-44ae-b3b5-f89c79ca86d1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:45 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e" returned: 0 in 0.771s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:45 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e Jul 08 19:08:45 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:45 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:08:45 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:45 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f.4f28be25-1c27-4208-a3d9-83c8f448ee8e" returned: 0 in 0.652s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:45 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.753s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f28be25-1c27-4208-a3d9-83c8f448ee8e" released by "_delete_snapshot" :: held 3.074s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" released by "delete_snapshot" :: held 3.097s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:45 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b 1G Jul 08 19:08:45 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:45 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Created reservations ['b3d2cf52-0020-4446-86bb-e74a4c1b09ba', '244ca2a5-7c47-4997-a67b-06fce8682bd6', '4487c240-5738-4ec4-af0b-a7efe5a95d9a', 'ebed4c52-29bc-431e-87a2-0b5ff5c9e0ce'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:46 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:08:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-1cffe602-d968-4b7b-ab1d-99768971fbff tempest-ProjectMemberTests-815295781 None] Lock "cinder-4f28be25-1c27-4208-a3d9-83c8f448ee8e-delete_snapshot" released by "delete_snapshot" :: held 3.232s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:46 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b 1G" returned: 0 in 0.818s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:46 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:08:46 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-9cbd4e04-8f63-462b-9ee6-25be61b2e07f-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "cinder-9cbd4e04-8f63-462b-9ee6-25be61b2e07f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21aed2-e287-4604-8630-6410ab328f75]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:47 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f Jul 08 19:08:47 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:47 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.695s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:47 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b is being set with open permissions: ugo+rw Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:47 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:08:47 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:47 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:47 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f Jul 08 19:08:47 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:48 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.650s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:48 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info Jul 08 19:08:48 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:48 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" returned: 0 in 0.638s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9cbd4e04-8f63-462b-9ee6-25be61b2e07f" released by "delete_volume" :: held 1.472s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Created reservations ['918024bb-679a-40d1-9fc6-6750c8bf8ad0', 'e0bc24ad-bd47-465c-9646-f6dc43074abf', '6dc0bea3-7d6c-47af-bd42-a7cac7e34da4', 'b3b64031-0a66-47e4-a47d-cb96ddb8bd65'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:48 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:08:48 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:48 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:48 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info is being set with open permissions: ugo+rw Jul 08 19:08:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:48 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info Jul 08 19:08:48 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:49 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.637s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:08:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-652602a9-7271-4b6b-aa79-00f00f034f0d tempest-ProjectMemberTests-815295781 None] Lock "cinder-9cbd4e04-8f63-462b-9ee6-25be61b2e07f-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:49 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.info" returned: 0 in 0.698s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-c6124e3a-bc2b-4b28-937e-f159670c5a92 tempest-SnapshotDependencyTests-1112576721 None] Create snapshot completed successfully Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (b1a0b0ae-b029-45d0-8fa8-e43cdb1b306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae9e554-7362-4f10-a655-e95f65145f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae9e554-7362-4f10-a655-e95f65145f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716209745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6ec083-f062-4e0f-81bd-836716b986d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:50Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c926b1f4-cb84-4a85-9882-920a92d10edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c926b1f4-cb84-4a85-9882-920a92d10edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5779d0-b591-4f54-83fa-f1817a512280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5779d0-b591-4f54-83fa-f1817a512280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6ec083-f062-4e0f-81bd-836716b986d9', 'volume_name': 'volume-4f6ec083-f062-4e0f-81bd-836716b986d9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7932bf9-4c12-4be7-b255-b958d1961565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7932bf9-4c12-4be7-b255-b958d1961565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597711f6-d516-4b79-88d6-b4f8db1d2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:49 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Volume 4f6ec083-f062-4e0f-81bd-836716b986d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6ec083-f062-4e0f-81bd-836716b986d9', 'volume_size': 1} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716209745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6ec083-f062-4e0f-81bd-836716b986d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:50Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Creating volume 4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:49 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:08:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:49 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 1073741824 Jul 08 19:08:49 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:50 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 1073741824" returned: 0 in 0.874s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:50 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 Jul 08 19:08:50 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Flow 'volume_create_manager' (2930a6e7-8edb-4a36-9877-d7c2508b2f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511c1890-3cfc-4104-b99c-980cee30e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511c1890-3cfc-4104-b99c-980cee30e836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db17bfc-6703-44f9-8439-a85689339050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a87d726d6d42448dfa514386ded058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1dab5ae8-c044-4b60-b959-ca7ca9242c9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:08:51Z,use_quota=True,user_id='3457cc1ea4944bc5a45507bc04d5d0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95240c0b-4124-4501-97cb-ac81bcb234ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95240c0b-4124-4501-97cb-ac81bcb234ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac05497e-94e9-4966-93fb-64b63cfc66ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac05497e-94e9-4966-93fb-64b63cfc66ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1db17bfc-6703-44f9-8439-a85689339050', 'volume_name': 'volume-1db17bfc-6703-44f9-8439-a85689339050', 'volume_size': 1, 'snapshot_id': '1dab5ae8-c044-4b60-b959-ca7ca9242c9b'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:50 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc35b06-3ea0-402f-ab7e-963374e0e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc35b06-3ea0-402f-ab7e-963374e0e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b99c9a-eec4-4425-81d2-3921cf718b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Volume 1db17bfc-6703-44f9-8439-a85689339050: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1db17bfc-6703-44f9-8439-a85689339050', 'volume_size': 1, 'snapshot_id': '1dab5ae8-c044-4b60-b959-ca7ca9242c9b'} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:51 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9" returned: 0 in 0.644s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.376s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-1db17bfc-6703-44f9-8439-a85689339050" by "_create_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597711f6-d516-4b79-88d6-b4f8db1d2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6ec083-f062-4e0f-81bd-836716b986d9', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638d57e4-4b71-4a26-a411-25cb22792951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-1db17bfc-6703-44f9-8439-a85689339050" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Creating volume 1db17bfc-6703-44f9-8439-a85689339050 from snapshot 1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" by "_copy_volume_from_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:51 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Volume volume-4f6ec083-f062-4e0f-81bd-836716b986d9 (4f6ec083-f062-4e0f-81bd-836716b986d9): created successfully Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638d57e4-4b71-4a26-a411-25cb22792951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (b1a0b0ae-b029-45d0-8fa8-e43cdb1b306e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] snapshot: 1dab5ae8-c044-4b60-b959-ca7ca9242c9b, volume: 1db17bfc-6703-44f9-8439-a85689339050, {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:08:51 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f8f96f7b-8997-45ef-906c-2e85cc1663f2 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec79e0d0-ec84-4ca5-8a7d-958778670517]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:51 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:08:51 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:08:52 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Creating direct copy from snapshot {{(pid=87229) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece5819-6900-430b-b758-1e4085a6602a]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:52 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:08:52 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:53 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.784s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:53 devstack cinder-volume[87229]: DEBUG cinder.utils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Path /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 not found in is_blk_device check {{(pid=87229) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 19:08:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:53 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 Jul 08 19:08:53 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:57 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050" returned: 0 in 4.632s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:57 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[969338aa-eaa3-48d6-97b8-7a73d8357202]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:57 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:08:57 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:58 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.905s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:58 devstack cinder-volume[87229]: DEBUG cinder.image.image_utils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Image conversion details: src /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 {{(pid=87229) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 19:08:58 devstack cinder-volume[87229]: INFO cinder.image.image_utils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Converted 1024.00 MB image at 221.02 MB/s Jul 08 19:08:58 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 is being set with open permissions: ugo+rw Jul 08 19:08:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:58 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 Jul 08 19:08:58 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:59 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050" returned: 0 in 0.636s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" released by "_copy_volume_from_snapshot" :: held 7.820s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-1db17bfc-6703-44f9-8439-a85689339050" released by "_create_volume_from_snapshot" :: held 7.864s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.893s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.271s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:DELETE=16,cinder:UPDATE=130,cinder:SELECT=96,cinder:INSERT=36 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=113,cinder:UPDATE=139,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot 12694914-6db2-4d90-9393-9fef35e5599b of volume 4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a166df-6d01-4837-a86c-662dea667287]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b99c9a-eec4-4425-81d2-3921cf718b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db17bfc-6703-44f9-8439-a85689339050', 'volume_size': 1, 'snapshot_id': '1dab5ae8-c044-4b60-b959-ca7ca9242c9b'}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b59576-fe33-4f7b-8df0-7d2bacc06e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:08:59 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Volume volume-1db17bfc-6703-44f9-8439-a85689339050 (1db17bfc-6703-44f9-8439-a85689339050): created successfully Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b59576-fe33-4f7b-8df0-7d2bacc06e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Flow 'volume_create_manager' (2930a6e7-8edb-4a36-9877-d7c2508b2f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:08:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0ecb76cc-9754-4929-811f-9fff193b01bb tempest-SnapshotDependencyTests-1112576721 None] Created volume successfully. Jul 08 19:08:59 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 Jul 08 19:08:59 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Deleting offline snapshot 1dab5ae8-c044-4b60-b959-ca7ca9242c9b of volume c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] snapshot_file for this snap is: volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fa1129-5061-4b1e-b324-733d01e3b789]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:08:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:08:59 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:08:59 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:00 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9" returned: 0 in 0.780s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:00 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b 1G Jul 08 19:09:00 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:00 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c49907-8e74-44d4-bc07-e53c77d77937]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:00 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:09:00 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:00 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b 1G" returned: 0 in 0.806s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6ec083-f062-4e0f-81bd-836716b986d9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:00 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6ec083-f062-4e0f-81bd-836716b986d9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b Jul 08 19:09:00 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:01 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.755s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:01 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:09:01 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:01 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6ec083-f062-4e0f-81bd-836716b986d9 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b" returned: 0 in 0.706s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:01 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b is being set with open permissions: ugo+rw Jul 08 19:09:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:01 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b Jul 08 19:09:01 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:02 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.814s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:02 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b Jul 08 19:09:02 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:02 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b" returned: 0 in 0.664s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:02 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info Jul 08 19:09:02 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:02 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a.1dab5ae8-c044-4b60-b959-ca7ca9242c9b" returned: 0 in 0.674s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1dab5ae8-c044-4b60-b959-ca7ca9242c9b" released by "_delete_snapshot" :: held 3.143s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" released by "delete_snapshot" :: held 3.174s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:02 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info" returned: 0 in 0.667s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:02 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info is being set with open permissions: ugo+rw Jul 08 19:09:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Created reservations ['4842fd0d-d2e4-4cc0-b791-bbd37aea908b', '4c8aba32-7999-4c69-967a-6ee0792b8499', '7441b78b-4e7b-467b-8798-10c3bc90c04f', '888a2b17-dd52-4e88-ba21-87c293ec108d'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:03 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info Jul 08 19:09:03 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Delete snapshot completed successfully. Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-54356aff-4759-4b47-bbb6-7a7576e7cca2 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-1dab5ae8-c044-4b60-b959-ca7ca9242c9b-delete_snapshot" released by "delete_snapshot" :: held 3.326s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:03 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.info" returned: 0 in 0.639s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-0edfb59a-68f6-4588-b657-ebb91ce169c8 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-c1f988a5-39db-4533-a89b-c2b9883ddc9a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-c1f988a5-39db-4533-a89b-c2b9883ddc9a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefe918-3775-4155-b5b4-025e91760875]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:04 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:09:04 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-12694914-6db2-4d90-9393-9fef35e5599b-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-12694914-6db2-4d90-9393-9fef35e5599b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-12694914-6db2-4d90-9393-9fef35e5599b" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-12694914-6db2-4d90-9393-9fef35e5599b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot 12694914-6db2-4d90-9393-9fef35e5599b of volume 4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5d0f9-0b12-47b1-8fd2-d945d9228cbd]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:04 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b Jul 08 19:09:04 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:04 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:04 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a Jul 08 19:09:04 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:05 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b" returned: 0 in 0.768s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6ec083-f062-4e0f-81bd-836716b986d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:09:05 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-c1f988a5-39db-4533-a89b-c2b9883ddc9a" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44b0f4-2237-4335-8c25-d0c2b80f9a95]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-c1f988a5-39db-4533-a89b-c2b9883ddc9a" released by "delete_volume" :: held 1.477s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Created reservations ['a192a51a-300f-4e6c-8fa2-f2a4d008cb6f', '0ee533ac-737c-4730-97eb-f0520ce3eea8', 'ec3d5eba-873a-4497-8f7f-39da433dfb40', '59ec710e-00fa-4069-967c-767564744f07'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:05 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 Jul 08 19:09:05 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:05 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:05 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-1db17bfc-6703-44f9-8439-a85689339050-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-1db17bfc-6703-44f9-8439-a85689339050-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" acquired by "delete_volume" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd416b60-ac44-407d-bc5d-53e4f1e22d02]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:06 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.672s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Deleted volume successfully. Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a66a03c7-b948-45f5-b69c-9879d51df905 tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-c1f988a5-39db-4533-a89b-c2b9883ddc9a-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:06 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9" returned: 0 in 0.854s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:06 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 Jul 08 19:09:06 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b Jul 08 19:09:06 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:06 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:07 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050" returned: 0 in 0.765s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:07 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050 Jul 08 19:09:07 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:07 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b" returned: 0 in 0.738s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:07 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b Jul 08 19:09:07 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:07 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1db17bfc-6703-44f9-8439-a85689339050" returned: 0 in 0.653s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-quobyte-1db17bfc-6703-44f9-8439-a85689339050" released by "delete_volume" :: held 1.461s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Created reservations ['abcaa08d-c43a-4383-bf8f-9152db3c33c5', '19fba995-d6bf-4c7c-aa9d-d6469531143d', 'fa40a5e5-b77c-4c7f-bf27-8bee5b8ec55b', 'd1d01d03-c9ba-414d-bdf3-0d1e437d2697'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:07 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9.12694914-6db2-4d90-9393-9fef35e5599b" returned: 0 in 0.684s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-12694914-6db2-4d90-9393-9fef35e5599b" released by "_delete_snapshot" :: held 3.149s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" released by "delete_snapshot" :: held 3.177s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:07 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:07 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Created reservations ['2c17ef05-dec2-4cac-bf10-4c65e5714028', 'd97054e9-231d-403a-ba34-809d9aa622d3', 'dbe915fc-fda1-43c3-ab08-7b4ee89a7ebc', 'b3d598cd-d972-405b-a828-f1de190200c9'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:07 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:09:07 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-bbd2bfa2-3844-4518-b645-bd5e7e71245f tempest-ProjectMemberTests-815295781 None] Lock "cinder-12694914-6db2-4d90-9393-9fef35e5599b-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:08 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:08 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Deleted volume successfully. Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-7dccc454-7edd-4e23-8ccf-660ec675c5dd tempest-SnapshotDependencyTests-1112576721 None] Lock "cinder-1db17bfc-6703-44f9-8439-a85689339050-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-4f6ec083-f062-4e0f-81bd-836716b986d9-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "cinder-4f6ec083-f062-4e0f-81bd-836716b986d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" acquired by "delete_volume" :: waited 0.021s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21567c-67c9-4332-a3db-adf32dc27263]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:08 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:09 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 Jul 08 19:09:09 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:09 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9" returned: 0 in 0.776s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:09 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:09 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9 Jul 08 19:09:09 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:10 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-4f6ec083-f062-4e0f-81bd-836716b986d9" returned: 0 in 0.672s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-4f6ec083-f062-4e0f-81bd-836716b986d9" released by "delete_volume" :: held 1.521s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Created reservations ['6818c2cf-b724-4d96-b6d0-0101469b9e62', '6bec8fbe-5b88-4281-b3c9-6264c42637a6', 'd175fee3-72db-4daf-8d18-87cda28b5017', '43bcf332-04f5-4468-b5a9-7744324defdb'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:10 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:10 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:10 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:11 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.723s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:11 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a97b4c09-9cd5-4e05-ba22-17fc1dbd1402 tempest-ProjectMemberTests-815295781 None] Lock "cinder-4f6ec083-f062-4e0f-81bd-836716b986d9-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (d4bcfc0d-4369-4170-90ee-b50779962425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffff80f-2929-4434-b951-a35850c0e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffff80f-2929-4434-b951-a35850c0e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461714654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1051fc0c-3a60-4438-857a-3a4dee3318df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:12Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c754e58-a2b0-4091-8265-88394dbce3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c754e58-a2b0-4091-8265-88394dbce3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a42869-722e-4656-8d43-642e43294492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a42869-722e-4656-8d43-642e43294492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1051fc0c-3a60-4438-857a-3a4dee3318df', 'volume_name': 'volume-1051fc0c-3a60-4438-857a-3a4dee3318df', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff0b4a6-6e9e-4a65-828c-99638b94a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff0b4a6-6e9e-4a65-828c-99638b94a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d863b-4a4f-46da-b328-4cffdfe1853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:11 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Volume 1051fc0c-3a60-4438-857a-3a4dee3318df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1051fc0c-3a60-4438-857a-3a4dee3318df', 'volume_size': 1} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461714654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1051fc0c-3a60-4438-857a-3a4dee3318df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:12Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Creating volume 1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:09:11 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:09:11 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:11 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df 1073741824 Jul 08 19:09:11 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:12 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df 1073741824" returned: 0 in 0.902s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:12 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:12 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df Jul 08 19:09:12 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:13 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d863b-4a4f-46da-b328-4cffdfe1853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1051fc0c-3a60-4438-857a-3a4dee3318df', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1556b91-5cfe-43a3-a14c-1ff17358fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:13 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Volume volume-1051fc0c-3a60-4438-857a-3a4dee3318df (1051fc0c-3a60-4438-857a-3a4dee3318df): created successfully Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1556b91-5cfe-43a3-a14c-1ff17358fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (d4bcfc0d-4369-4170-90ee-b50779962425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:13 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-fe6fc4de-2968-49d2-b276-23975c334c30 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a of volume 1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a96b9a-ca4f-4230-97df-0b439a436b0c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:13 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:13 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df Jul 08 19:09:13 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:14 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df" returned: 0 in 0.915s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:14 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:14 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a 1G Jul 08 19:09:14 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:15 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a 1G" returned: 0 in 0.904s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:15 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051fc0c-3a60-4438-857a-3a4dee3318df -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:15 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051fc0c-3a60-4438-857a-3a4dee3318df -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a Jul 08 19:09:15 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:16 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051fc0c-3a60-4438-857a-3a4dee3318df -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" returned: 0 in 0.682s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:16 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a is being set with open permissions: ugo+rw Jul 08 19:09:16 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:16 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a Jul 08 19:09:16 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:17 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" returned: 0 in 0.752s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:17 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info Jul 08 19:09:17 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:17 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info" returned: 0 in 0.658s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:17 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info is being set with open permissions: ugo+rw Jul 08 19:09:17 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:17 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info Jul 08 19:09:17 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:18 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:18 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:18 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.info" returned: 0 in 0.628s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.640s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:18 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ba760236-5d02-412d-a4e5-8ba9b9201352 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:09:18 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.631s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:09:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a of volume 1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f62a49-5b5f-4136-8b94-f405a8887e10]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:19 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a Jul 08 19:09:19 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:19 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" returned: 0 in 0.786s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1051fc0c-3a60-4438-857a-3a4dee3318df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff0f476-6d1c-4647-b796-956384938dde]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:19 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:20 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df Jul 08 19:09:20 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:20 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df" returned: 0 in 0.757s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:20 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:20 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a Jul 08 19:09:20 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:21 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" returned: 0 in 0.729s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:21 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:21 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a Jul 08 19:09:21 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:22 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:22 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df.d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" returned: 0 in 0.624s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a" released by "_delete_snapshot" :: held 2.984s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" released by "delete_snapshot" :: held 3.006s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:22 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Created reservations ['4cdf985f-fffd-4937-ae5e-3f50b5fbb2e5', '7d406d63-1182-4908-9188-0a7af546f061', 'b7c69e2d-6e58-4562-aaf1-9897ffa0339e', '1eaf243f-684d-46ee-be5e-224dea6fb269'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:22 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:09:22 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-e123da0c-4f52-487f-ad09-29ee979520d0 tempest-ProjectMemberTests-815295781 None] Lock "cinder-d1f9005c-99c2-4e87-b8a2-dcfbc4174f5a-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-1051fc0c-3a60-4438-857a-3a4dee3318df-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "cinder-1051fc0c-3a60-4438-857a-3a4dee3318df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eaf925-aee6-4556-ba40-54fa7109ead4]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:23 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:23 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df Jul 08 19:09:23 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:24 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df" returned: 0 in 0.725s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:24 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df Jul 08 19:09:24 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:24 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-1051fc0c-3a60-4438-857a-3a4dee3318df" returned: 0 in 0.634s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-1051fc0c-3a60-4438-857a-3a4dee3318df" released by "delete_volume" :: held 1.412s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Created reservations ['61811328-74d8-418d-aafd-f62f997629e8', '12108600-bf33-4000-b307-dae9c3a43035', '9ddb0cc4-4fa2-4600-826f-4b5a1881be6f', 'bae27bd3-e1ba-4f58-b5b2-ac85ab1afedd'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:24 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:24 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:24 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:25 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.654s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:25 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b3c7d8d6-bf47-4dec-97e0-253fc9dc4b67 tempest-ProjectMemberTests-815295781 None] Lock "cinder-1051fc0c-3a60-4438-857a-3a4dee3318df-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (73d141dc-6739-4346-b2ac-4d3efa69229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e435dc4-f5e8-4495-a70a-0c6887f536be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e435dc4-f5e8-4495-a70a-0c6887f536be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229985603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8307a5f-7f52-44f7-a66e-967d5b832750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:26Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9696944c-9a92-44a4-ac66-068c280b29c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9696944c-9a92-44a4-ac66-068c280b29c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30d759-6bda-434c-96d6-08b33ccd61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30d759-6bda-434c-96d6-08b33ccd61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8307a5f-7f52-44f7-a66e-967d5b832750', 'volume_name': 'volume-e8307a5f-7f52-44f7-a66e-967d5b832750', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c2bc13-e0b5-43b8-a2cf-37a9aa5ce896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c2bc13-e0b5-43b8-a2cf-37a9aa5ce896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dea05a-3a12-4cd3-91c2-674784c449ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:25 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Volume e8307a5f-7f52-44f7-a66e-967d5b832750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8307a5f-7f52-44f7-a66e-967d5b832750', 'volume_size': 1} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229985603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8307a5f-7f52-44f7-a66e-967d5b832750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:26Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Creating volume e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:25 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:09:26 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:26 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 1073741824 Jul 08 19:09:26 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:26 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 1073741824" returned: 0 in 0.807s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:26 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:26 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 Jul 08 19:09:26 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:27 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750" returned: 0 in 0.641s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dea05a-3a12-4cd3-91c2-674784c449ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8307a5f-7f52-44f7-a66e-967d5b832750', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198b7a51-5b1f-4548-8bff-c8c9a0ad4394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:27 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Volume volume-e8307a5f-7f52-44f7-a66e-967d5b832750 (e8307a5f-7f52-44f7-a66e-967d5b832750): created successfully Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198b7a51-5b1f-4548-8bff-c8c9a0ad4394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:27 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (73d141dc-6739-4346-b2ac-4d3efa69229f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:27 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-2a3535ae-0298-40ca-a5a5-8aea1795f137 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot f03c3449-4b70-4b13-bc6b-de7d403518d7 of volume e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7b5d1-bed5-450b-978a-0f6ffce6d50d]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:28 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 Jul 08 19:09:28 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:28 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750" returned: 0 in 0.752s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:28 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:28 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 1G Jul 08 19:09:28 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:29 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 1G" returned: 0 in 0.798s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:29 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8307a5f-7f52-44f7-a66e-967d5b832750 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:29 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8307a5f-7f52-44f7-a66e-967d5b832750 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 Jul 08 19:09:29 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:30 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8307a5f-7f52-44f7-a66e-967d5b832750 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7" returned: 0 in 0.716s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:30 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 is being set with open permissions: ugo+rw Jul 08 19:09:30 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:30 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 Jul 08 19:09:30 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:31 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7" returned: 0 in 0.685s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:31 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info Jul 08 19:09:31 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:31 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info" returned: 0 in 0.666s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:31 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info is being set with open permissions: ugo+rw Jul 08 19:09:31 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:31 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info Jul 08 19:09:31 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:32 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.info" returned: 0 in 0.656s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:32 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:32 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-8c4f43c3-f950-4719-a007-16fe20ac8b23 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-f03c3449-4b70-4b13-bc6b-de7d403518d7-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-f03c3449-4b70-4b13-bc6b-de7d403518d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-f03c3449-4b70-4b13-bc6b-de7d403518d7" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-f03c3449-4b70-4b13-bc6b-de7d403518d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot f03c3449-4b70-4b13-bc6b-de7d403518d7 of volume e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca17fe-0dfa-44ba-911d-83084fce4fa9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:33 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:33 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 Jul 08 19:09:33 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:34 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7" returned: 0 in 0.718s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8307a5f-7f52-44f7-a66e-967d5b832750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8fa71f-d227-4158-a559-ba83f1b3747c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:34 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 Jul 08 19:09:34 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:34 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750" returned: 0 in 0.726s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:34 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:34 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 Jul 08 19:09:34 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:35 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7" returned: 0 in 0.702s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:35 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:35 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7 Jul 08 19:09:35 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:36 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750.f03c3449-4b70-4b13-bc6b-de7d403518d7" returned: 0 in 0.619s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-f03c3449-4b70-4b13-bc6b-de7d403518d7" released by "_delete_snapshot" :: held 2.852s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" released by "delete_snapshot" :: held 2.874s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Created reservations ['45c895b2-75a9-46c7-a7da-9c5df6a8a72a', '5cf9ee16-61c8-40e7-a29e-ecb80b1054ac', 'ef3f1cb2-ebe8-440c-b249-2faba31efc4f', '0de5543b-b932-4f51-ad07-394482c20f14'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:36 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-49da48e1-13c8-49d1-97ee-57dd3783a1a8 tempest-ProjectMemberTests-815295781 None] Lock "cinder-f03c3449-4b70-4b13-bc6b-de7d403518d7-delete_snapshot" released by "delete_snapshot" :: held 2.996s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-e8307a5f-7f52-44f7-a66e-967d5b832750-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "cinder-e8307a5f-7f52-44f7-a66e-967d5b832750-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" acquired by "delete_volume" :: waited 0.016s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f9bcc-defa-420d-85e3-61d2433e863c]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:36 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:36 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 Jul 08 19:09:36 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:37 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750" returned: 0 in 0.730s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:37 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750 Jul 08 19:09:37 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:37 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:37 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-e8307a5f-7f52-44f7-a66e-967d5b832750" returned: 0 in 0.629s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-e8307a5f-7f52-44f7-a66e-967d5b832750" released by "delete_volume" :: held 1.415s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Created reservations ['daee33e4-6c63-4d46-aa6f-65447c1a1eb0', '7680c9b3-5ea6-45cd-b1b7-66594fd28c48', 'f7affdb1-8402-493b-9098-b33eeb6f4dbc', '97dcb5a1-e061-4255-a56c-7e2b372bdbf7'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:38 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:38 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:38 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.618s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:38 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:09:38 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-a2341ed9-4101-4935-b5be-268ad4ee2512 tempest-ProjectMemberTests-815295781 None] Lock "cinder-e8307a5f-7f52-44f7-a66e-967d5b832750-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (8300510c-9aff-4d22-a211-388f246d57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46730dd-f337-4129-8c8b-dfd60bdf8952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46730dd-f337-4129-8c8b-dfd60bdf8952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291304107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46eca00-fc96-4f43-86b1-768b9f3d2721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:39Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6212d5c1-87f6-42d2-95ab-b9e0fded7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6212d5c1-87f6-42d2-95ab-b9e0fded7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076e18a6-6180-4df2-b17a-fe862d7dafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076e18a6-6180-4df2-b17a-fe862d7dafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46eca00-fc96-4f43-86b1-768b9f3d2721', 'volume_name': 'volume-d46eca00-fc96-4f43-86b1-768b9f3d2721', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f48e1e-b0f7-4ccd-ba11-80111033f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f48e1e-b0f7-4ccd-ba11-80111033f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbd6fb-4863-4647-ba50-6e93d00ad605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:39 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Volume d46eca00-fc96-4f43-86b1-768b9f3d2721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46eca00-fc96-4f43-86b1-768b9f3d2721', 'volume_size': 1} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291304107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46eca00-fc96-4f43-86b1-768b9f3d2721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:39Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Creating volume d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:09:39 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:09:39 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:39 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 1073741824 Jul 08 19:09:39 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:40 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 1073741824" returned: 0 in 0.796s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:40 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 Jul 08 19:09:40 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:40 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbd6fb-4863-4647-ba50-6e93d00ad605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46eca00-fc96-4f43-86b1-768b9f3d2721', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b20cfd-497e-49a6-8d13-312c15f3a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:40 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Volume volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 (d46eca00-fc96-4f43-86b1-768b9f3d2721): created successfully Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b20cfd-497e-49a6-8d13-312c15f3a8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:40 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (8300510c-9aff-4d22-a211-388f246d57cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:40 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ef77970a-ebdf-429f-925b-237020546193 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:09:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:41 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Creating offline snapshot 11935908-d418-4b7e-bf55-9e49565db9aa of volume d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:09:41 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02100ddf-4b1b-4827-b4eb-6e4b03449b56]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:41 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:41 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 Jul 08 19:09:41 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:42 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721" returned: 0 in 0.746s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:42 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa 1G Jul 08 19:09:42 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:42 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa 1G" returned: 0 in 0.764s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:42 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:42 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa Jul 08 19:09:42 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:43 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa" returned: 0 in 0.699s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:43 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa is being set with open permissions: ugo+rw Jul 08 19:09:43 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:43 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa Jul 08 19:09:43 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:44 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa" returned: 0 in 0.614s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:44 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:44 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info Jul 08 19:09:44 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:45 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:45 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info is being set with open permissions: ugo+rw Jul 08 19:09:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:45 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info Jul 08 19:09:45 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:45 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.info" returned: 0 in 0.613s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:45 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:45 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-3ac47da7-9017-48fa-8f33-157f5488fd8a tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-11935908-d418-4b7e-bf55-9e49565db9aa-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-11935908-d418-4b7e-bf55-9e49565db9aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-11935908-d418-4b7e-bf55-9e49565db9aa" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-11935908-d418-4b7e-bf55-9e49565db9aa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot 11935908-d418-4b7e-bf55-9e49565db9aa of volume d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37af984-1932-4a3f-8c2a-affdfc1bbf89]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:46 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:46 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa Jul 08 19:09:46 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:47 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa" returned: 0 in 0.756s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:47 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46eca00-fc96-4f43-86b1-768b9f3d2721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:09:47 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf868486-7d2f-49ad-90e8-88204871691b]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:47 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:47 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 Jul 08 19:09:47 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:48 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721" returned: 0 in 0.773s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:48 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa Jul 08 19:09:48 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:48 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa" returned: 0 in 0.691s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:48 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:48 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa Jul 08 19:09:48 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:49 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721.11935908-d418-4b7e-bf55-9e49565db9aa" returned: 0 in 0.612s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-11935908-d418-4b7e-bf55-9e49565db9aa" released by "_delete_snapshot" :: held 2.921s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" released by "delete_snapshot" :: held 2.943s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Created reservations ['3ba13263-4d25-4529-afb5-0dd35918fc82', 'cf11304a-cf64-4d46-8597-13dac5b7cb89', 'c35a5c15-6476-4b1f-895e-db0c2d7eccfc', 'a45a2577-b00f-4e85-9e53-cb50726b9212'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:49 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-b9f3df7b-c3eb-44e4-b9e0-222014267c72 tempest-ProjectMemberTests-815295781 None] Lock "cinder-11935908-d418-4b7e-bf55-9e49565db9aa-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-d46eca00-fc96-4f43-86b1-768b9f3d2721-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "cinder-d46eca00-fc96-4f43-86b1-768b9f3d2721-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32956f-8794-4d8a-b18e-ddab8412ac47]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:49 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:49 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 Jul 08 19:09:49 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:50 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721" returned: 0 in 0.740s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:50 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:50 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721 Jul 08 19:09:50 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:51 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-d46eca00-fc96-4f43-86b1-768b9f3d2721" returned: 0 in 0.616s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-d46eca00-fc96-4f43-86b1-768b9f3d2721" released by "delete_volume" :: held 1.414s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Created reservations ['2916eae4-c43e-4634-be8c-c9306905eb97', 'b5e20eb4-e438-4032-a6b4-e9a1ad1ee2bc', '47b12fcb-1390-47b9-870d-220bf44b776c', '757fae01-a033-4891-9e6a-851ae080f98e'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:51 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:51 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:09:51 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:52 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.635s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:09:52 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-9a72bc92-a78a-4646-885b-13c13f932e61 tempest-ProjectMemberTests-815295781 None] Lock "cinder-d46eca00-fc96-4f43-86b1-768b9f3d2721-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87229) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (112a49c9-4158-4c27-8faa-9b9ae53f6ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddefef27-4e11-46fd-ad7c-240bb19d2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddefef27-4e11-46fd-ad7c-240bb19d2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499517976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bcfe62-85cc-44a8-a194-33207558fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:52Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5f06e2-c60a-48d0-b052-cf8ea1079b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5f06e2-c60a-48d0-b052-cf8ea1079b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e22c44-97f6-4f94-955a-af2e429fa7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e22c44-97f6-4f94-955a-af2e429fa7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bcfe62-85cc-44a8-a194-33207558fd9a', 'volume_name': 'volume-80bcfe62-85cc-44a8-a194-33207558fd9a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94828e07-3c2f-4388-984d-e45eeff751d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94828e07-3c2f-4388-984d-e45eeff751d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf696184-b2ca-4aa5-b2b7-1f390f3d9049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:52 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Volume 80bcfe62-85cc-44a8-a194-33207558fd9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bcfe62-85cc-44a8-a194-33207558fd9a', 'volume_size': 1} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499517976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bcfe62-85cc-44a8-a194-33207558fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e0ea58b5c4bdaaf356d85530a1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:09:52Z,use_quota=True,user_id='ae9304c6eb734936bd2f82de0b915bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5774ace9-6de4-4a34-970d-6ed8f6f9f19e),volume_type_id=5774ace9-6de4-4a34-970d-6ed8f6f9f19e)}" {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Creating volume 80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Selected osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf as target Quobyte volume. {{(pid=87229) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:09:52 devstack cinder-volume[87229]: INFO cinder.volume.drivers.remotefs [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] casted to osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf Jul 08 19:09:52 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a 1073741824 {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:52 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a 1073741824 Jul 08 19:09:52 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:53 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a 1073741824" returned: 0 in 0.792s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:53 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a Jul 08 19:09:53 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:53 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a" returned: 0 in 0.634s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:53 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'} {{(pid=87229) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:09:53 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf696184-b2ca-4aa5-b2b7-1f390f3d9049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bcfe62-85cc-44a8-a194-33207558fd9a', 'volume_size': 1}' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928d1920-28ea-42aa-964f-fafec8cdbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:09:54 devstack cinder-volume[87229]: INFO cinder.volume.flows.manager.create_volume [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Volume volume-80bcfe62-85cc-44a8-a194-33207558fd9a (80bcfe62-85cc-44a8-a194-33207558fd9a): created successfully Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928d1920-28ea-42aa-964f-fafec8cdbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87229) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Flow 'volume_create_manager' (112a49c9-4158-4c27-8faa-9b9ae53f6ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87229) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:09:54 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-ed129f0a-2e40-4293-bd08-eff35ef5a0b8 tempest-ProjectMemberTests-815295781 None] Created volume successfully. Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Creating offline snapshot 9b129df7-838a-463e-820d-0599ac07f6ec of volume 80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[202bb40e-d25a-4c8e-a228-1091b7988da1]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:09:54 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:54 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a Jul 08 19:09:54 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:55 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a" returned: 0 in 0.769s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:55 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec 1G {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:55 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec 1G Jul 08 19:09:55 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:56 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec 1G" returned: 0 in 0.797s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:56 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80bcfe62-85cc-44a8-a194-33207558fd9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:56 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80bcfe62-85cc-44a8-a194-33207558fd9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec Jul 08 19:09:56 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:57 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80bcfe62-85cc-44a8-a194-33207558fd9a -F qcow2 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec" returned: 0 in 0.743s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:57 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec is being set with open permissions: ugo+rw Jul 08 19:09:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:57 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec Jul 08 19:09:57 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:57 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec" returned: 0 in 0.715s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:57 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:57 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info Jul 08 19:09:57 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:58 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info" returned: 0 in 0.636s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:58 devstack cinder-volume[87229]: WARNING cinder.volume.drivers.remotefs [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info is being set with open permissions: ugo+rw Jul 08 19:09:58 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:09:58 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info Jul 08 19:09:58 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:09:59 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 08 19:09:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.info" returned: 0 in 0.697s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:09:59 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:09:59 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-4e2e8d43-655f-487a-a9f6-13e3103a4225 tempest-ProjectMemberTests-815295781 None] Create snapshot completed successfully Jul 08 19:09:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-9b129df7-838a-463e-820d-0599ac07f6ec-delete_snapshot" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:09:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-9b129df7-838a-463e-820d-0599ac07f6ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:09:59 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" by "delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-9b129df7-838a-463e-820d-0599ac07f6ec" by "_delete_snapshot" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9b129df7-838a-463e-820d-0599ac07f6ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Deleting offline snapshot 9b129df7-838a-463e-820d-0599ac07f6ec of volume 80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] snapshot_file for this snap is: volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbe88f4-fa88-460c-ae76-175383baa0eb]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:00 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec Jul 08 19:10:00 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:00 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec" returned: 0 in 0.779s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.remotefs [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80bcfe62-85cc-44a8-a194-33207558fd9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87229) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2453d50b-3d6c-417b-9cba-58c316e15bf9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:10:00 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:00 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a Jul 08 19:10:00 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:01 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a" returned: 0 in 0.822s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:01 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:01 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec Jul 08 19:10:01 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:02 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec" returned: 0 in 0.736s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:02 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:02 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec Jul 08 19:10:02 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:03 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a.9b129df7-838a-463e-820d-0599ac07f6ec" returned: 0 in 0.661s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-9b129df7-838a-463e-820d-0599ac07f6ec" released by "_delete_snapshot" :: held 3.088s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" released by "delete_snapshot" :: held 3.109s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=97,cinder:SELECT=75,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:UPDATE=95,cinder:DELETE=10,cinder:SELECT=73,cinder:INSERT=24 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Created reservations ['d4f6546f-9d74-43c5-b3c9-bb5c956ec5c5', '91d71453-7e7d-4652-94ed-805cbd1c6164', 'b9575edf-7c28-4374-969b-f542d487555d', '8e84bc5c-0318-4211-ac55-1fc62a964b75'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:10:03 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Delete snapshot completed successfully. Jul 08 19:10:03 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-f94c47f6-0a1e-4ff3-b7dc-cebca40b8818 tempest-ProjectMemberTests-815295781 None] Lock "cinder-9b129df7-838a-463e-820d-0599ac07f6ec-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-80bcfe62-85cc-44a8-a194-33207558fd9a-delete_volume" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "cinder-80bcfe62-85cc-44a8-a194-33207558fd9a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Acquiring lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" by "delete_volume" {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" acquired by "delete_volume" :: waited 0.015s {{(pid=87229) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467fe35-de3f-40f4-997c-5d8f847ee4c9]: (4, 'qcow2') {{(pid=88383) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:10:04 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:04 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a Jul 08 19:10:04 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:05 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a" returned: 0 in 0.761s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:05 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a Jul 08 19:10:05 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:05 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a/volume-80bcfe62-85cc-44a8-a194-33207558fd9a" returned: 0 in 0.677s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "cinder-quobyte-80bcfe62-85cc-44a8-a194-33207558fd9a" released by "delete_volume" :: held 1.499s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG cinder.quota [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Created reservations ['fd6d16c9-5f41-446c-9a56-e1c8f6318929', '0bd7d314-4ddc-4261-9785-5e91699daad4', '4d58c393-7acc-4ba2-b160-b7fc03e70e6a', 'f65b788b-83df-4f7f-a424-6a07582e173c'] {{(pid=87229) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:10:05 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:05 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:10:05 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:06 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:06 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.625s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:06 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:10:06 devstack cinder-volume[87229]: INFO cinder.volume.manager [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Deleted volume successfully. Jul 08 19:10:06 devstack cinder-volume[87229]: DEBUG cinder.coordination [None req-648cb5bb-9217-4372-b747-6208ae38e121 tempest-ProjectMemberTests-815295781 None] Lock "cinder-80bcfe62-85cc-44a8-a194-33207558fd9a-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87229) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:10:15 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:10:16 devstack cinder-volume[87229]: DEBUG dbcounter [-] [87229] Writing DB stats cinder:INSERT=5,cinder:UPDATE=18,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf': None} {{(pid=87229) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG cinder.volume.drivers.quobyte [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5fe6948-6889-4fce-b62f-0bf849b0ccdf'] {{(pid=87229) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.lockutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87229) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:10:18 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a Jul 08 19:10:18 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:10:18 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_concurrency.processutils [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25d07720d0b947ec772e646cb61f643a" returned: 0 in 0.612s {{(pid=87229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG cinder.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Notifying Schedulers of capabilities ... {{(pid=87229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG oslo_service.periodic_task [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] Running periodic task VolumeManager._thread_info {{(pid=87229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread count: 28 {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 19:10:18 devstack cinder-volume[87229]: DEBUG cinder.volume.manager [None req-3b0b7c68-c315-4dd6-93d8-972c5688db9f None None] thread info: [<_MainThread(MainThread, started 126000796770432)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}